00000001:02000400:1.0F:1782240980.218546:0:3291:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1782240997.292950:0:3513:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1782240999.209015:0:3576:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 500 MB/s 00000001:01000000:3.0:1782240999.458906:0:3576:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 883 MB/s 00000001:01000000:2.0:1782240999.709866:0:3576:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4131 MB/s 00000020:02000000:3.0:1782241000.528523:0:3606:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_g947bf2b 00000400:02000000:1.0:1782241001.653925:0:3621:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.204.158@tcp [8/256/0/180] 00008000:02000000:2.0:1782241006.117457:0:3771:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0F:1782241068.914439:0:5737:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1782241081.823294:0:6487:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782241081.823301:0:6487:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1782241081.823302:0:6487:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1782241081.823439:0:6487:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000dd670e30 00000080:02000400:1.0:1782241081.823449:0:6487:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1782241081.835124:0:6487:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1782241081.835136:0:6487:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1782241081.835162:0:6487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000007574f262) 00000020:00000080:1.0:1782241081.835177:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1782241081.894164:0:6487:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1782241081.894233:0:6487:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1782241081.922211:0:6487:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1782241081.922438:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1782241081.922446:0:6487:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782241081.922458:0:6487:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e191d0 00000020:01000004:1.0:1782241081.922464:0:6487:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1782241081.922469:0:6487:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1782241081.922473:0:6487:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000dd670e30 from MGS 00000020:01000004:1.0:1782241081.922478:0:6487:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1782241081.922487:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f1b99e15) 00000020:00000080:1.0:1782241081.922497:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1782241081.922558:0:6487:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dd670e30 from MGS, refs=2 00080000:01000000:1.0:1782241081.922563:0:6487:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782241081.922568:0:6487:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e191de 00000100:00100000:1.0:1782241081.922705:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1782241081.923019:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1782241081.923026:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1782241081.927958:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1782241081.927972:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1782241081.930841:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782241081.931036:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1782241081.931042:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1782241081.931708:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1782241081.931716:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1782241081.932326:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1782241081.932334:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1782241081.939787:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241081.939794:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241081.939796:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241081.948433:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241081.948440:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241081.948442:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241081.957066:0:6487:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1782241081.963149:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1782241082.207441:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2255 MB/s 00000001:01000000:0.0:1782241082.456872:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2807 MB/s 00000001:01000000:0.0:1782241082.707687:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 415 MB/s 00000001:01000000:2.0:1782241082.957345:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 699 MB/s 00080000:10000000:2.0:1782241082.971907:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1782241082.996294:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1782241083.006344:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1782241083.006422:0:6487:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1782241083.006475:0:6487:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1782241083.006788:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1782241083.006818:0:6487:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1782241083.007115:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782241083.007250:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1782241083.007256:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1782241083.008041:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1782241083.008050:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1782241083.008344:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1782241083.008350:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1782241083.008869:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1782241083.008901:0:6487:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.158@tcp' 00000020:01000004:1.0:1782241083.008903:0:6487:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1782241083.008947:0:6487:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.158@tcp (typ=mgc) 00000020:00000080:1.0:1782241083.008958:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.158@tcp (000000004e447a90) 00000020:00000080:1.0:1782241083.008972:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1782241083.009047:0:6487:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000be601813@MGC192.168.204.158@tcp: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241083.009187:0:6487:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.158@tcp-0 is initialized 00000040:01000000:1.0:1782241083.009192:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.158@tcp ctxt 1 is initialized 00000100:00080000:2.0:1782241083.011157:0:6506:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1782241083.012124:0:6508:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1782241083.015196:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.158@tcp (uuid 62797b42-772f-434f-be35-dfdfcff291e0) 00000020:00000080:0.0:1782241083.015223:0:6487:0:(genops.c:1406:class_connect()) connect: client 62797b42-772f-434f-be35-dfdfcff291e0, cookie 0xc9959f2fb1e191ec 00000100:00080000:0.0:1782241083.015235:0:6487:0:(import.c:512:import_select_connection()) MGC192.168.204.158@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782241083.015240:0:6487:0:(import.c:626:import_select_connection()) MGC192.168.204.158@tcp: import 00000000be601813 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241083.015282:0:6487:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b1cd9e3e x1868815139864704/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782241083.015430:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b1cd9e3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:62797b42-772f-434f-be35-dfdfcff291e0:3636:1868815139864704:0@lo:250: 00000100:00100000:3.0:1782241083.015488:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241083.015556:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782241083.015792:0:6487:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 62797b42-772f-434f-be35-dfdfcff291e0->MGS 00000020:01000004:0.0:1782241083.015810:0:6487:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1782241083.015816:0:6487:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1782241083.015835:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a9518007) 00000020:00000080:0.0:1782241083.015848:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1782241083.019844:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139864704 00000100:00100000:2.0:1782241083.019860:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139864704 00000100:00100000:2.0:1782241083.019916:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241083.019923:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e86db26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1868815139864704:12345-0@lo:250: 00010000:00080000:2.0:1782241083.019949:0:6503:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 62797b42-772f-434f-be35-dfdfcff291e0@0@lo t0 exp 0000000000000000 cur 146 last 0 00000020:00000080:2.0:1782241083.019975:0:6503:0:(genops.c:1406:class_connect()) connect: client 62797b42-772f-434f-be35-dfdfcff291e0, cookie 0xc9959f2fb1e191fa 00000100:00080000:2.0:1782241083.020120:0:6503:0:(import.c:65:import_set_state_nolock()) 00000000f48e7bdb : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241083.021943:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e86db26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+5:3636:x1868815139864704:12345-0@lo:250: Request processed in 2014us (6449us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241083.021958:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782241083.024393:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782241083.024569:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1782241083.024576:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1782241083.025790:0:3636:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.158@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1782241083.025803:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.158@tcp: connect to target with instance 0 00000100:00080000:3.0:1782241083.025812:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.158@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1782241083.025817:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1782241083.025821:0:3636:0:(import.c:65:import_set_state_nolock()) 00000000be601813 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1782241083.025825:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1782241083.025834:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1782241083.025841:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b1cd9e3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:62797b42-772f-434f-be35-dfdfcff291e0:3636:1868815139864704:0@lo:250: 00000100:00100000:0.0:1782241083.026737:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1782241083.026746:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1782241083.027622:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1782241083.027631:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1782241083.028635:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782241083.030901:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1782241083.030909:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1782241083.031388:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1782241083.031395:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1782241083.072948:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782241083.073239:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1782241083.073246:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1782241083.074495:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1782241083.074503:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1782241083.075247:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782241083.075466:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782241083.075471:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1782241083.076009:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782241083.076016:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1782241083.077698:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782241083.077901:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782241083.077907:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1782241083.078525:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782241083.078531:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1782241083.079039:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782241083.079179:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782241083.079184:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1782241083.081282:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782241083.081355:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1782241083.099525:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782241083.099698:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782241083.099704:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1782241083.101231:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782241083.101241:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1782241083.102062:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782241083.102077:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1782241083.102831:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1782241083.102860:0:6487:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1782241083.102867:0:6487:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.158@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1782241083.102971:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.158@tcp ctxt 0 is initialized 00000020:01000004:1.0:1782241083.103006:0:6487:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.158@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1782241083.103010:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1782241083.103012:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782241083.103013:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782241083.103014:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782241083.103015:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782241083.103016:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782241083.103017:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782241083.103018:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782241083.103020:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782241083.103021:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782241083.103022:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782241083.103023:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782241083.103025:0:6487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1782241083.103027:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782241083.103028:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782241083.103029:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782241083.103030:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782241083.103031:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782241083.103032:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782241083.103033:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782241083.103034:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782241083.103035:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782241083.103036:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782241083.103037:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782241083.103038:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782241083.103073:0:6487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1782241083.103090:0:6487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007d5fcddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139864832:0@lo:253: 00000100:00100000:1.0:1782241083.103188:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241083.103232:0:6487:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d783ebd6 going to sleep for 11 seconds 00000100:00100000:2.0:1782241083.103388:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139864832 00000100:00100000:2.0:1782241083.103396:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139864832 00000100:00100000:2.0:1782241083.103442:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241083.103451:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b73dce1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+5:6487:x1868815139864832:12345-0@lo:253: 20000000:01000000:2.0:1782241083.103501:0:6505:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782241083.103505:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1782241083.104490:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1782241083.104564:0:6505:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1782241083.104904:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782241083.106063:0:6527:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1782241083.106526:0:6505:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782241083.106531:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1782241083.106537:0:6505:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1782241083.106539:0:6505:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1782241083.106551:0:6505:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1782241083.106702:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782241083.107007:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1782241083.107028:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1782241083.107046:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1782241083.107062:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1782241083.107078:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1782241083.107129:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1782241083.107138:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1782241083.107150:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1782241083.107155:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1782241083.107179:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1782241083.107186:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1782241083.107198:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1782241083.107211:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1782241083.107237:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1782241083.107241:0:6505:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1782241083.107248:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782241083.107518:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1782241083.107529:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1782241083.107544:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1782241083.107560:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1782241083.107574:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1782241083.107582:0:6505:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1782241083.107610:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1782241083.107618:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1782241083.107631:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1782241083.107648:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1782241083.107662:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1782241083.107670:0:6505:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1782241083.107695:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1782241083.107703:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1782241083.107716:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1782241083.107731:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1782241083.107815:0:6505:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1782241083.107845:0:6505:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1782241083.107851:0:6505:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1782241083.109375:0:6528:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1782241083.110557:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1782241083.110586:0:6505:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.158@tcp for mdt 20000000:01000000:3.0:1782241083.110588:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.158@tcp (null) (null) (null) 00000040:00080000:3.0:1782241083.110603:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1782241083.110609:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1782241083.110622:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1782241083.110628:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.158@tcp (null) (null) 00000040:00080000:3.0:1782241083.110641:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1782241083.110648:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1782241083.110661:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1782241083.110676:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1782241083.110703:0:6505:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782241083.110706:0:6505:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782241083.110710:0:6505:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782241083.110801:0:6505:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782241083.110804:0:6505:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782241083.111558:0:6529:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1782241083.111741:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1782241083.112108:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1782241083.112136:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1782241083.112147:0:6505:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782241083.112149:0:6505:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782241083.112650:0:6530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1782241083.112917:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1782241083.112937:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1782241083.112949:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1782241083.112960:0:6505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782241083.112962:0:6505:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1782241083.112967:0:6505:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1782241083.112969:0:6505:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1782241083.112979:0:6505:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1782241083.112985:0:6505:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1782241083.113364:0:6531:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1782241083.113476:0:6505:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1782241083.135088:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1782241083.135135:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1782241083.135151:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1782241083.135170:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782241083.135191:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e19201 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241083.135207:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e19201 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241083.135216:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e19201 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241083.135222:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e19201 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241083.135228:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e19201 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241083.135234:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e19201 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241083.135240:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000081d70f40 already unused, calling callback (00000000a921267b) 00010000:00010000:0.0:1782241083.135243:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e19201 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241083.135250:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e19201 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241083.135261:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e19201 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241083.135267:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e19201 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241083.135281:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e19201 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782241083.135310:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1782241083.146252:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b73dce1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+5:6487:x1868815139864832:12345-0@lo:253: Request processed in 42794us (43058us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241083.146272:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241083.146466:0:6487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007d5fcddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139864832:0@lo:253: 10000000:01000000:1.0:1782241083.146482:0:6487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1782241083.146485:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782241083.146487:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782241083.146489:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782241083.146490:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1782241083.146491:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782241083.146504:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782241083.146506:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782241083.146507:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782241083.146508:0:6487:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1782241083.146510:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782241083.146511:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782241083.146532:0:6487:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000dd670e30 from lustre-MDT0000 10000000:01000000:1.0:1782241083.146562:0:6487:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1782241083.146565:0:6487:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782241083.146569:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff890e43633380 10000000:01000000:1.0:1782241083.146574:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782241083.146581:0:6487:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff890e43633380 from 1 10000000:01000000:1.0:1782241083.146584:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782241083.146618:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 000000006427a263/0xc9959f2fb1e19208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.146629:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 000000006427a263/0xc9959f2fb1e19208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.146638:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 000000006427a263/0xc9959f2fb1e19208 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241083.146662:0:6487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007d5fcddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139864960:0@lo:101: 00000100:00100000:1.0:1782241083.146700:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241083.146751:0:6487:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ecf98b38 going to sleep for 11 seconds 00000100:00100000:2.0:1782241083.146822:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139864960 00000100:00100000:2.0:1782241083.146829:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139864960 00000100:00100000:2.0:1782241083.146960:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782241083.146969:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f344cc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+5:6487:x1868815139864960:12345-0@lo:101: 00010000:00010000:2.0:1782241083.146983:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241083.146997:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000949ffbd5/0xc9959f2fb1e1920f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19208 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.147020:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000949ffbd5/0xc9959f2fb1e1920f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19208 expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.147028:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000949ffbd5/0xc9959f2fb1e1920f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19208 expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.147046:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000949ffbd5, rc 0) 00000100:00100000:2.0:1782241083.147094:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f344cc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+6:6487:x1868815139864960:12345-0@lo:101: Request processed in 127us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241083.147110:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782241083.147172:0:6487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007d5fcddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139864960:0@lo:101: 00010000:00010000:1.0:1782241083.147183:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 000000006427a263/0xc9959f2fb1e19208 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1920f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.147190:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 000000006427a263/0xc9959f2fb1e19208 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1920f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241083.147248:0:6487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007d5fcddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139865088:0@lo:501: 00000100:00100000:1.0:1782241083.147285:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241083.147604:0:6487:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ecf98b38 going to sleep for 11 seconds 00000100:00100000:0.0:1782241083.147690:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139865088 00000100:00100000:0.0:1782241083.147695:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139865088 00000100:00100000:0.0:1782241083.147717:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782241083.147723:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f0114ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+6:6487:x1868815139865088:12345-0@lo:501: 00000100:00100000:0.0:1782241083.147827:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f0114ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+6:6487:x1868815139865088:12345-0@lo:501: Request processed in 104us (542us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782241083.147833:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782241083.147906:0:6487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007d5fcddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139865088:0@lo:501: 10000000:01000000:1.0:1782241083.147930:0:6487:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782241083.147950:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 000000006427a263/0xc9959f2fb1e19208 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1920f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.147958:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 000000006427a263/0xc9959f2fb1e19208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1920f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241083.147965:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff890e48138000 10000000:01000000:1.0:1782241083.147969:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782241083.147973:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff890e48138000 10000000:01000000:1.0:1782241083.147975:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1782241083.147977:0:6487:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff890e48138000 from 1 10000000:01000000:1.0:1782241083.147979:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1782241083.147995:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 000000008a526691/0xc9959f2fb1e19216 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.148002:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 000000008a526691/0xc9959f2fb1e19216 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.148009:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 000000008a526691/0xc9959f2fb1e19216 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241083.148020:0:6487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007d5fcddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139865216:0@lo:101: 00000100:00100000:1.0:1782241083.148073:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241083.148098:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139865216 00000100:00100000:1.0:1782241083.148102:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139865216 00000100:00100000:1.0:1782241083.148119:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782241083.148124:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003efb2fdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+6:6487:x1868815139865216:12345-0@lo:101: 00010000:00010000:1.0:1782241083.148132:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241083.148140:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d9f192ce/0xc9959f2fb1e1921d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19216 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.148165:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d9f192ce/0xc9959f2fb1e1921d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19216 expref: 7 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.148174:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d9f192ce/0xc9959f2fb1e1921d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19216 expref: 7 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.148180:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d9f192ce, rc 0) 00000100:00100000:1.0:1782241083.148201:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003efb2fdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+7:6487:x1868815139865216:12345-0@lo:101: Request processed in 78us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241083.148206:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782241083.148234:0:6487:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ecf98b38 going to sleep for 11 seconds 00000100:00100000:1.0:1782241083.148245:0:6487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007d5fcddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139865216:0@lo:101: 00010000:00010000:1.0:1782241083.148254:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 000000008a526691/0xc9959f2fb1e19216 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1921d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.148261:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 000000008a526691/0xc9959f2fb1e19216 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1921d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241083.148270:0:6487:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1782241083.148273:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 000000008a526691/0xc9959f2fb1e19216 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1921d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.148284:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 000000008a526691/0xc9959f2fb1e19216 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1921d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241083.148305:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782241083.148308:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782241083.148312:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff890e48138000 10000000:01000000:1.0:1782241083.148315:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1782241083.148317:0:6487:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1782241083.148319:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782241083.148331:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 00000000ae062131/0xc9959f2fb1e19224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.148337:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 00000000ae062131/0xc9959f2fb1e19224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.148361:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 00000000ae062131/0xc9959f2fb1e19224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241083.148372:0:6487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007d5fcddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139865344:0@lo:101: 00000100:00100000:1.0:1782241083.148395:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241083.148413:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139865344 00000100:00100000:1.0:1782241083.148417:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139865344 00000100:00100000:1.0:1782241083.148433:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782241083.148437:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000052f4114 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+7:6487:x1868815139865344:12345-0@lo:101: 00010000:00010000:1.0:1782241083.148444:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241083.148450:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000af5b57da/0xc9959f2fb1e1922b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19224 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.148471:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000af5b57da/0xc9959f2fb1e1922b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19224 expref: 8 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.148478:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000af5b57da/0xc9959f2fb1e1922b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19224 expref: 8 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.148483:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000af5b57da, rc 0) 00000100:00100000:1.0:1782241083.148503:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000052f4114 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+8:6487:x1868815139865344:12345-0@lo:101: Request processed in 66us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241083.148509:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782241083.148529:0:6487:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ecf98b38 going to sleep for 11 seconds 00000100:00100000:1.0:1782241083.148540:0:6487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007d5fcddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139865344:0@lo:101: 00010000:00010000:1.0:1782241083.148547:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 00000000ae062131/0xc9959f2fb1e19224 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1922b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.148554:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 00000000ae062131/0xc9959f2fb1e19224 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1922b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241083.148587:0:6487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007d5fcddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139865472:0@lo:501: 00000100:00100000:1.0:1782241083.148607:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241083.148623:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139865472 00000100:00100000:1.0:1782241083.148626:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139865472 00000100:00100000:1.0:1782241083.148638:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782241083.148642:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016547ec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+8:6487:x1868815139865472:12345-0@lo:501: 00000100:00100000:1.0:1782241083.148713:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016547ec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+9:6487:x1868815139865472:12345-0@lo:501: Request processed in 70us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241083.148719:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782241083.148744:0:6487:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ecf98b38 going to sleep for 11 seconds 00000100:00100000:1.0:1782241083.148783:0:6487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007d5fcddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139865472:0@lo:501: 00000100:00100000:1.0:1782241083.148808:0:6487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007d5fcddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139865600:0@lo:503: 00000100:00100000:1.0:1782241083.148842:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241083.148858:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139865600 00000100:00100000:1.0:1782241083.148861:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139865600 00000100:00100000:1.0:1782241083.148875:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782241083.148880:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c22cb05d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+9:6487:x1868815139865600:12345-0@lo:503: 00000100:00100000:1.0:1782241083.148966:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c22cb05d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+9:6487:x1868815139865600:12345-0@lo:503: Request processed in 85us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241083.148972:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782241083.149002:0:6487:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ecf98b38 going to sleep for 11 seconds 00000100:00100000:1.0:1782241083.149013:0:6487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007d5fcddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139865600:0@lo:503: 00000100:00100000:0.0:1782241083.150739:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002d89d035 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:6532:1868815139865728:0@lo:502: 00000100:00100000:0.0:1782241083.150823:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241083.150847:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ca29dc73 going to sleep for 11 seconds 00000100:00100000:1.0:1782241083.150903:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139865728 00000100:00100000:1.0:1782241083.150908:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139865728 00000100:00100000:1.0:1782241083.150947:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782241083.150955:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009674b80e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+9:6532:x1868815139865728:12345-0@lo:502: 00000100:00100000:1.0:1782241083.151520:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009674b80e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+9:6532:x1868815139865728:12345-0@lo:502: Request processed in 565us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241083.151529:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782241083.151730:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002d89d035 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:6532:1868815139865728:0@lo:502: 00000020:01000000:0.0:1782241083.151850:0:6532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241083.151947:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241083.151950:0:6532:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782241083.151955:0:6532:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1782241083.151959:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782241083.151972:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d1a64d85) 00000020:00000080:1.0:1782241083.151992:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1782241083.151997:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1782241083.152258:0:6532:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1782241083.152266:0:6532:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e19239 00000020:00000080:1.0:1782241083.152612:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1782241083.152617:0:6532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241083.152620:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241083.152622:0:6532:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782241083.152624:0:6532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241083.152628:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241083.152629:0:6532:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1782241083.152632:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782241083.152646:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009d41c66c) 00000020:00000080:1.0:1782241083.152657:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1782241083.152662:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1782241083.152664:0:6532:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1782241083.152666:0:6532:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1782241083.152671:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782241083.152728:0:6532:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dd670e30 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1782241083.152740:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000c80c2327) 00000020:00000080:1.0:1782241083.152748:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1782241083.153284:0:6532:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1782241083.153406:0:6532:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e1924e 00000020:00000080:1.0:1782241083.153513:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1782241083.153519:0:6532:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1782241083.153524:0:6532:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc9959f2fb1e19255 00080000:01000000:1.0:1782241083.153529:0:6532:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1782241083.153533:0:6532:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1925c 00080000:10000000:1.0:1782241083.154187:0:6532:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1782241083.154326:0:6532:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1782241083.163742:0:6532:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1782241083.268558:0:6532:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1782241083.268958:0:6532:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1782241083.272252:0:6532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1782241083.272687:0:6532:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1782241083.282656:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b165d485) 00000020:00000080:3.0:1782241083.282688:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1782241083.282820:0:6532:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1782241083.282828:0:6532:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1926a 00000020:00000080:2.0:1782241083.287379:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1782241083.290184:0:6532:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1782241083.301078:0:6532:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1782241083.312900:0:6532:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1782241083.328106:0:6532:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1782241083.331199:0:6532:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1782241083.337814:0:6532:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1782241083.339986:0:6532:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc9959f2fb1e19271 00000020:00000080:0.0:1782241083.341721:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1782241083.341743:0:6532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241083.341774:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241083.341777:0:6532:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1782241083.341785:0:6532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782241083.341789:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241083.341791:0:6532:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782241083.341795:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782241083.341809:0:6532:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782241083.341813:0:6532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241083.341815:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241083.341817:0:6532:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1782241083.341819:0:6532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782241083.341824:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241083.341826:0:6532:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1782241083.341830:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1782241083.341917:0:6532:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1782241083.342002:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002d89d035 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:6532:1868815139865856:0@lo:502: 00000100:00100000:0.0:1782241083.342116:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241083.342190:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ca29dc73 going to sleep for 11 seconds 00000100:00100000:2.0:1782241083.342325:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139865856 00000100:00100000:2.0:1782241083.342340:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139865856 00000100:00100000:2.0:1782241083.342438:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782241083.342447:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eefe66fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+9:6532:x1868815139865856:12345-0@lo:502: 00000100:00100000:2.0:1782241083.342640:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eefe66fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+9:6532:x1868815139865856:12345-0@lo:502: Request processed in 195us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241083.342649:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782241083.344005:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002d89d035 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:6532:1868815139865856:0@lo:502: 00000020:01000000:0.0:1782241083.344065:0:6532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241083.344077:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241083.344080:0:6532:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1782241083.344087:0:6532:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1782241083.345929:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1782241083.345982:0:6487:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782241083.346004:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 00000000ae062131/0xc9959f2fb1e19224 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1922b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.346045:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 00000000ae062131/0xc9959f2fb1e19224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1922b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241083.346055:0:6487:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890e48138000 from 1 10000000:01000000:1.0:1782241083.346059:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782241083.346111:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 00000000d3105a27/0xc9959f2fb1e19278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.346118:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 00000000d3105a27/0xc9959f2fb1e19278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.346129:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 00000000d3105a27/0xc9959f2fb1e19278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241083.346156:0:6487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007d5fcddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139865984:0@lo:101: 00000100:00100000:1.0:1782241083.346240:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241083.346317:0:6487:0:(client.c:2701:ptlrpc_set_wait()) set 0000000082cd74c1 going to sleep for 11 seconds 00000100:00100000:2.0:1782241083.346629:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139865984 00000100:00100000:2.0:1782241083.346638:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139865984 00000100:00100000:2.0:1782241083.346725:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782241083.346735:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050481968 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+9:6487:x1868815139865984:12345-0@lo:101: 00010000:00010000:2.0:1782241083.346779:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241083.346797:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005284f6f9/0xc9959f2fb1e1927f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19278 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.346829:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005284f6f9/0xc9959f2fb1e1927f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19278 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.346841:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005284f6f9/0xc9959f2fb1e1927f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19278 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.346850:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005284f6f9, rc 0) 00000100:00100000:2.0:1782241083.346921:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050481968 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+10:6487:x1868815139865984:12345-0@lo:101: Request processed in 187us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241083.346942:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782241083.347006:0:6487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007d5fcddf pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139865984:0@lo:101: 00010000:00010000:2.0:1782241083.347023:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 00000000d3105a27/0xc9959f2fb1e19278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1927f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.347031:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 00000000d3105a27/0xc9959f2fb1e19278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1927f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241083.347610:0:6487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004f72a5c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139866112:0@lo:256: 00000100:00100000:2.0:1782241083.347661:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241083.347685:0:6487:0:(client.c:2701:ptlrpc_set_wait()) set 000000009e205365 going to sleep for 11 seconds 00000100:00100000:2.0:1782241083.347707:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139866112 00000100:00100000:2.0:1782241083.347713:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139866112 00000100:00100000:2.0:1782241083.347748:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782241083.347783:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5133c8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+10:6487:x1868815139866112:12345-0@lo:256: 20000000:01000000:2.0:1782241083.347802:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1782241083.347810:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1782241083.347898:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5133c8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+10:6487:x1868815139866112:12345-0@lo:256: Request processed in 144us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241083.347907:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782241083.347949:0:6487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004f72a5c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139866112:0@lo:256: 10000000:01000000:2.0:1782241083.348532:0:6487:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782241083.348557:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 00000000d3105a27/0xc9959f2fb1e19278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1927f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.348567:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 00000000d3105a27/0xc9959f2fb1e19278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1927f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241083.348586:0:6487:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e48138000 from 1 10000000:01000000:2.0:1782241083.348590:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782241083.348624:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 00000000bc374b6c/0xc9959f2fb1e19286 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.348632:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 00000000bc374b6c/0xc9959f2fb1e19286 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.348642:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 00000000bc374b6c/0xc9959f2fb1e19286 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241083.348657:0:6487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004f72a5c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139866240:0@lo:101: 00000100:00100000:2.0:1782241083.348699:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241083.348719:0:6487:0:(client.c:2701:ptlrpc_set_wait()) set 000000009e205365 going to sleep for 11 seconds 00000100:00100000:2.0:1782241083.348785:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139866240 00000100:00100000:2.0:1782241083.348790:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139866240 00000100:00100000:2.0:1782241083.348824:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782241083.348831:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b68f42b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+10:6487:x1868815139866240:12345-0@lo:101: 00010000:00010000:2.0:1782241083.348840:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241083.348854:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000365472a2/0xc9959f2fb1e1928d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19286 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.348875:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000365472a2/0xc9959f2fb1e1928d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19286 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.355393:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000365472a2/0xc9959f2fb1e1928d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19286 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.355412:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000365472a2, rc 0) 00000100:00100000:2.0:1782241083.355613:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b68f42b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+11:6487:x1868815139866240:12345-0@lo:101: Request processed in 6780us (6911us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241083.355624:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782241083.357128:0:6487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004f72a5c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139866240:0@lo:101: 00010000:00010000:0.0:1782241083.357166:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 00000000bc374b6c/0xc9959f2fb1e19286 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1928d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241083.357181:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 00000000bc374b6c/0xc9959f2fb1e19286 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1928d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241083.357496:0:6487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002cf443de pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139866368:0@lo:501: 00000100:00100000:2.0:1782241083.357570:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241083.357625:0:6487:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ac91b1b5 going to sleep for 11 seconds 00000100:00100000:1.0:1782241083.357699:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139866368 00000100:00100000:1.0:1782241083.357706:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139866368 00000100:00100000:1.0:1782241083.357793:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782241083.357803:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a36d531 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+11:6487:x1868815139866368:12345-0@lo:501: 00000100:00100000:1.0:1782241083.358036:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a36d531 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+11:6487:x1868815139866368:12345-0@lo:501: Request processed in 234us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241083.358044:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782241083.358183:0:6487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002cf443de pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139866368:0@lo:501: 00000100:00100000:3.0:1782241083.358256:0:6487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f591e17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139866496:0@lo:503: 00000100:00100000:3.0:1782241083.358305:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241083.358333:0:6487:0:(client.c:2701:ptlrpc_set_wait()) set 0000000035949bf3 going to sleep for 11 seconds 00000100:00100000:1.0:1782241083.358378:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139866496 00000100:00100000:1.0:1782241083.358384:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139866496 00000100:00100000:1.0:1782241083.358418:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782241083.358425:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000307b90ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+11:6487:x1868815139866496:12345-0@lo:503: 00000040:00080000:1.0:1782241083.358469:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782241083.358507:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000307b90ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+11:6487:x1868815139866496:12345-0@lo:503: Request processed in 83us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241083.358514:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782241083.358596:0:6487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f591e17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139866496:0@lo:503: 00000040:00080000:3.0:1782241083.360123:0:6536:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1782241083.360413:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1782241083.360451:0:6487:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782241083.360475:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 00000000bc374b6c/0xc9959f2fb1e19286 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1928d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.360489:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 00000000bc374b6c/0xc9959f2fb1e19286 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1928d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241083.360548:0:6487:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782241083.360552:0:6487:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff890e48138000 10000000:01000000:1.0:1782241083.360555:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff890e48138000 10000000:01000000:1.0:1782241083.360560:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782241083.360566:0:6487:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e48138000 from 1 10000000:01000000:1.0:1782241083.360569:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782241083.360608:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 000000009b49ce59/0xc9959f2fb1e19294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.360616:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 000000009b49ce59/0xc9959f2fb1e19294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.360628:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 000000009b49ce59/0xc9959f2fb1e19294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241083.360649:0:6487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000049f9cba2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139866624:0@lo:101: 00000100:00100000:1.0:1782241083.360714:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241083.360773:0:6487:0:(client.c:2701:ptlrpc_set_wait()) set 0000000083688c06 going to sleep for 11 seconds 00000100:00100000:1.0:1782241083.360796:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139866624 00000100:00100000:1.0:1782241083.360803:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139866624 00000100:00100000:1.0:1782241083.360844:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782241083.360851:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b6be01e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+11:6487:x1868815139866624:12345-0@lo:101: 00010000:00010000:1.0:1782241083.360865:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241083.360877:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007b6b3654/0xc9959f2fb1e1929b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19294 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.360917:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b6b3654/0xc9959f2fb1e1929b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19294 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.360926:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007b6b3654/0xc9959f2fb1e1929b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19294 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.360934:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007b6b3654, rc 0) 00000100:00100000:1.0:1782241083.360971:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b6be01e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+12:6487:x1868815139866624:12345-0@lo:101: Request processed in 120us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241083.360977:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782241083.361031:0:6487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000049f9cba2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139866624:0@lo:101: 00010000:00010000:1.0:1782241083.361045:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 000000009b49ce59/0xc9959f2fb1e19294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1929b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241083.361053:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 000000009b49ce59/0xc9959f2fb1e19294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1929b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241083.361109:0:6487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000049f9cba2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139866752:0@lo:501: 00000100:00100000:1.0:1782241083.361135:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241083.361147:0:6487:0:(client.c:2701:ptlrpc_set_wait()) set 0000000083688c06 going to sleep for 11 seconds 00000100:00100000:1.0:1782241083.361165:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139866752 00000100:00100000:1.0:1782241083.361168:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139866752 00000100:00100000:1.0:1782241083.361189:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782241083.361195:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000852f5853 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+12:6487:x1868815139866752:12345-0@lo:501: 00000100:00100000:1.0:1782241083.361326:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000852f5853 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+12:6487:x1868815139866752:12345-0@lo:501: Request processed in 132us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241083.361334:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782241083.361360:0:6487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000049f9cba2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139866752:0@lo:501: 00000100:00100000:1.0:1782241083.361386:0:6487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000049f9cba2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139866880:0@lo:503: 00000100:00100000:1.0:1782241083.361425:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241083.361437:0:6487:0:(client.c:2701:ptlrpc_set_wait()) set 0000000083688c06 going to sleep for 11 seconds 00000100:00100000:1.0:1782241083.361449:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139866880 00000100:00100000:1.0:1782241083.361452:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139866880 00000100:00100000:1.0:1782241083.361472:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782241083.361477:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b021b8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+12:6487:x1868815139866880:12345-0@lo:503: 00000100:00100000:1.0:1782241083.361560:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b021b8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+12:6487:x1868815139866880:12345-0@lo:503: Request processed in 83us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241083.361566:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782241083.361612:0:6487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000049f9cba2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139866880:0@lo:503: 00000100:00100000:1.0:1782241083.361864:0:6537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000049f9cba2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:6537:1868815139867008:0@lo:502: 00000100:00100000:1.0:1782241083.361915:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241083.361944:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139867008 00000100:00100000:1.0:1782241083.361948:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139867008 00000100:00100000:1.0:1782241083.361966:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782241083.361971:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a266f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+12:6537:x1868815139867008:12345-0@lo:502: 00000100:00100000:1.0:1782241083.362042:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a266f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+12:6537:x1868815139867008:12345-0@lo:502: Request processed in 70us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241083.362052:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782241083.362078:0:6537:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d4fd10d3 going to sleep for 11 seconds 00000100:00100000:1.0:1782241083.362087:0:6537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000049f9cba2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:6537:1868815139867008:0@lo:502: 00000020:01000004:1.0:1782241083.362143:0:6537:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1782241083.362160:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000072954a7e) 00000020:00000080:1.0:1782241083.362180:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1782241083.362381:0:6537:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dd670e30 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782241083.362385:0:6537:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000dd670e30 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782241083.362388:0:6537:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000dd670e30 4 00010000:00080000:1.0:1782241083.362429:0:6537:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000478cd5c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241083.377950:0:6537:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1782241083.378090:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1782241083.378152:0:6537:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782241083.378172:0:6537:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc9959f2fb1e192a9 00000100:00080000:1.0:1782241083.378187:0:6537:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782241083.378193:0:6537:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000478cd5c using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241083.378245:0:6537:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000049f9cba2 x1868815139867136/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241083.378281:0:6537:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1782241083.379432:0:6537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d0464605 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:6537:1868815139867264:0@lo:502: 00000100:00100000:1.0:1782241083.379548:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241083.379619:0:6537:0:(client.c:2701:ptlrpc_set_wait()) set 000000003ebbc15d going to sleep for 11 seconds 00000100:00100000:2.0:1782241083.379719:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000049f9cba2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1868815139867136:0@lo:38: 00000100:00100000:2.0:1782241083.379787:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241083.379979:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139867264 00000100:00100000:3.0:1782241083.379989:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139867264 00000100:00100000:3.0:1782241083.380054:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782241083.380064:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016851084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+12:6537:x1868815139867264:12345-0@lo:502: 00000100:00100000:3.0:1782241083.380235:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016851084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+12:6537:x1868815139867264:12345-0@lo:502: Request processed in 172us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241083.380244:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782241083.380296:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139867136 00000100:00100000:3.0:1782241083.380300:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139867136 00000100:00100000:3.0:1782241083.380331:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782241083.380336:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a46cd23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815139867136:12345-0@lo:38: 00000100:00100000:3.0:1782241083.380385:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a46cd23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815139867136:12345-0@lo:38: Request processed in 48us (599us total) trans 0 rc -11/-11 00000100:00100000:3.0:1782241083.380392:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241083.380461:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782241083.380471:0:3636:0:(import.c:65:import_set_state_nolock()) 000000000478cd5c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782241083.380475:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1782241083.380479:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000049f9cba2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1868815139867136:0@lo:38: 00000100:00100000:2.0:1782241083.380512:0:6537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d0464605 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:6537:1868815139867264:0@lo:502: 00000040:00080000:2.0:1782241083.380540:0:6537:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1782241083.380936:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1782241083.380963:0:6487:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782241083.380981:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 000000009b49ce59/0xc9959f2fb1e19294 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1929b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241083.380995:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 000000009b49ce59/0xc9959f2fb1e19294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1929b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782241083.381053:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782241083.381056:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782241083.381057:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241083.381058:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241083.381059:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241083.381061:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241083.381062:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241083.381063:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782241083.381065:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782241083.381066:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782241083.381068:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241083.381069:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782241083.381073:0:6487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1782241083.381076:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782241083.381081:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782241083.381082:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241083.381083:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241083.381084:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241083.381085:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241083.381086:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241083.381087:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782241083.381087:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782241083.381088:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782241083.381089:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241083.381090:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782241083.381112:0:6487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782241083.381127:0:6487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001f591e17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139867392:0@lo:253: 00000100:00100000:3.0:1782241083.381177:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241083.381197:0:6487:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bb128d3b going to sleep for 11 seconds 00000100:00100000:1.0:1782241083.381275:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139867392 00000100:00100000:1.0:1782241083.381281:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139867392 00000100:00100000:1.0:1782241083.381326:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782241083.381333:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e678be6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+12:6487:x1868815139867392:12345-0@lo:253: 20000000:01000000:1.0:1782241083.381371:0:6503:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782241083.381389:0:6503:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1782241083.388350:0:6503:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782241083.388377:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1782241083.388412:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782241083.388423:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782241083.388445:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e192b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241083.388465:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005284f6f9/0xc9959f2fb1e1927f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19278 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241083.388497:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e192b0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241083.388536:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005284f6f9/0xc9959f2fb1e1927f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19278 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241083.388551:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005284f6f9/0xc9959f2fb1e1927f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19278 expref: 12 pid: 6505 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241083.388565:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002d89d035 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1868815139867520:0@lo:104: 00000100:00100000:0.0:1782241083.388631:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241083.388693:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set 0000000044890b9f going to sleep for 11 seconds 00000100:00100000:3.0:1782241083.388706:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139867520 00000100:00100000:3.0:1782241083.388719:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139867520 00000100:00100000:3.0:1782241083.388817:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782241083.388828:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000557cba7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:6526:x1868815139867520:12345-0@lo:104: 00010000:00010000:3.0:1782241083.388847:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: 00000000d3105a27/0xc9959f2fb1e19278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1927f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241083.388961:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782241083.388967:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000557cba7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:6526:x1868815139867520:12345-0@lo:104: Request processed in 142us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241083.388975:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241083.389113:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002d89d035 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1868815139867520:0@lo:104: 00010000:00010000:1.0:1782241083.389142:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e192b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.389219:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241083.389226:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: 00000000d3105a27/0xc9959f2fb1e19278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1927f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.389234:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d3105a27 already unused, calling callback (000000002488b196) 10000000:00010000:2.0:1782241083.389239:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: 00000000d3105a27/0xc9959f2fb1e19278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1927f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.389248:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: 00000000d3105a27/0xc9959f2fb1e19278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1927f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241083.389256:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: 00000000d3105a27/0xc9959f2fb1e19278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1927f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241083.389277:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782241083.389318:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: 00000000d3105a27/0xc9959f2fb1e19278 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1927f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.389326:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782241083.389344:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: 00000000d3105a27/0xc9959f2fb1e19278 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1927f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.389350:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: 00000000d3105a27/0xc9959f2fb1e19278 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1927f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.389371:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241083.389373:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241083.389374:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241083.389495:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a5b74260 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139867648:0@lo:103: 00000100:00100000:1.0:1782241083.389543:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241083.389776:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e678be6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+12:6487:x1868815139867392:12345-0@lo:253: Request processed in 8420us (8575us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241083.389787:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782241083.389901:0:6487:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001f591e17 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:6487:1868815139867392:0@lo:253: 10000000:01000000:1.0:1782241083.389912:0:6487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1782241083.389916:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782241083.389918:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782241083.389919:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782241083.389921:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782241083.389922:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782241083.389924:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782241083.389925:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782241083.389927:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782241083.389928:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782241083.389929:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782241083.389931:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782241083.389932:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782241083.389948:0:6487:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1782241083.393086:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139867648 00000100:00100000:2.0:1782241083.393106:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139867648 00010000:00010000:2.0:1782241083.393159:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005284f6f9/0xc9959f2fb1e1927f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19278 expref: 12 pid: 6505 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241083.393219:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241083.393229:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb753b60 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+12:3638:x1868815139867648:12345-0@lo:103: 00010000:00010000:2.0:1782241083.393246:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241083.393251:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005284f6f9/0xc9959f2fb1e1927f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19278 expref: 12 pid: 6505 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.393264:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005284f6f9/0xc9959f2fb1e1927f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19278 expref: 12 pid: 6505 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.393284:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005284f6f9/0xc9959f2fb1e1927f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19278 expref: 12 pid: 6505 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.393323:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e192b0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.393332:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e192b0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782241083.393353:0:6495:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004931395s 00010000:00010000:2.0:1782241083.393358:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e192b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.393364:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e192b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.393371:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e192b0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.393377:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e192b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.393383:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000081d70f40 already unused, calling callback (00000000a921267b) 00010000:00010000:2.0:1782241083.393387:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e192b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.393395:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e192b0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.393416:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e192b0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.393429:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241083.393526:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb753b60 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+11:3638:x1868815139867648:12345-0@lo:103: Request processed in 298us (3983us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241083.393535:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241083.393610:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a5b74260 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139867648:0@lo:103: 00010000:00010000:2.0:1782241083.393646:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e192b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.393653:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e192b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241083.393658:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000081d70f40/0xc9959f2fb1e192b0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1782241083.396629:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1782241083.396819:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1782241083.397064:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1782241083.397208:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1782241083.397381:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1782241083.397537:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1782241083.400635:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1782241083.400876:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1782241083.401093:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1782241083.401279:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1782241083.401507:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1782241083.401675:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1782241083.413537:0:6487:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1782241083.428806:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1782241083.429342:0:6543:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1782241083.430938:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1782241083.431082:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1782241083.431524:0:6487:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1782241083.431533:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1782241083.431638:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782241083.432671:0:6487:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:0.0:1782241083.433350:0:6542:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1782241083.433356:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:1.0:1782241083.433990:0:6487:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1782241083.434053:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1782241083.438941:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1782241083.439685:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1782241083.440796:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1782241083.440983:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000040:00080000:2.0:1782241083.441237:0:6543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1782241083.441521:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000040:00080000:2.0:1782241083.446078:0:6543:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1782241083.446188:0:6543:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1782241083.446194:0:6543:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1782241083.447308:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1782241083.447488:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1782241083.447637:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1782241083.448472:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1782241083.448636:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1782241083.448920:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1782241083.449077:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1782241083.449359:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1782241083.449500:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1782241083.449642:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1782241083.450250:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1782241083.450446:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1782241083.450591:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1782241083.451088:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1782241083.451377:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1782241083.451519:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1782241083.451711:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1782241083.454493:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1782241083.454750:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1782241083.455042:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1782241083.455404:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1782241083.455549:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1782241083.455706:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1782241083.456137:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1782241083.456350:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1782241083.456495:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1782241083.456642:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1782241083.456910:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1782241083.457210:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1782241083.457437:0:6487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1782241083.461912:0:6487:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1782241083.461965:0:6487:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa60ac1a2b988 00100000:10000000:2.0:1782241083.461974:0:6487:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1782241083.462750:0:6487:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782241083.462801:0:6487:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.158@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782241083.462828:0:6487:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1782241083.462855:0:6487:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1782241083.465491:0:6487:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782241083.465721:0:6487:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1782241084.037185:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241085.067424:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241086.084865:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241087.109145:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241088.133248:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782241088.195913:0:6788:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1782241088.783733:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1782241088.783743:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782241088.783747:0:468:0:(import.c:65:import_set_state_nolock()) 000000000478cd5c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782241088.783787:0:468:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000478cd5c using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241088.783809:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dc98f5ad x1868815139867904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782241088.783941:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782241088.783953:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007ab81772 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139867776:0@lo:400: 00000100:00100000:1.0:1782241088.784021:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241088.784082:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139867776 00000100:00100000:1.0:1782241088.784088:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139867776 00000100:00100000:1.0:1782241088.784130:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782241088.784138:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000448d76d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+11:3640:x1868815139867776:12345-0@lo:400: 00000100:00100000:1.0:1782241088.784187:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000448d76d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+11:3640:x1868815139867776:12345-0@lo:400: Request processed in 50us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241088.784195:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782241088.784237:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007ab81772 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139867776:0@lo:400: 00000100:00100000:2.0:1782241088.785803:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000dc98f5ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1868815139867904:0@lo:38: 00000100:00100000:2.0:1782241088.785863:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241088.786383:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139867904 00000100:00100000:1.0:1782241088.786391:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139867904 00000100:00100000:1.0:1782241088.786432:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241088.786440:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b74260 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1868815139867904:12345-0@lo:38: 00010000:00080000:1.0:1782241088.786470:0:6512:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:1.0:1782241088.786528:0:6512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc9959f2fb1e192b7 00000004:00100000:1.0:1782241088.786588:0:6512:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782241088.786705:0:6512:0:(import.c:65:import_set_state_nolock()) 000000000f6720d2 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241088.786795:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b74260 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1868815139867904:12345-0@lo:38: Request processed in 355us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241088.786804:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782241088.787012:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dc98f5ad x1868815139867904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782241088.787029:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1782241088.787041:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1782241088.787046:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782241088.787048:0:3636:0:(import.c:65:import_set_state_nolock()) 000000000478cd5c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782241088.787054:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000dc98f5ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1868815139867904:0@lo:38: 00000020:00000004:2.0:1782241089.042202:0:6840:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782241089.042686:0:6840:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782241089.157954:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782241089.797415:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782241089.797423:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890e48138000 from 3 10000000:01000000:0.0:1782241089.797428:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782241089.797468:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 00000000a1e7bc7b/0xc9959f2fb1e192be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241089.797481:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 00000000a1e7bc7b/0xc9959f2fb1e192be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241089.797491:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 00000000a1e7bc7b/0xc9959f2fb1e192be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241089.797514:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000dc79a0b1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139868032:0@lo:101: 00000100:00100000:0.0:1782241089.797576:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241089.797627:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 0000000071f7bdef going to sleep for 11 seconds 00000100:00100000:2.0:1782241089.798926:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139868032 00000100:00100000:2.0:1782241089.799081:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139868032 00000100:00100000:2.0:1782241089.799132:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782241089.799139:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3c02ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+11:6508:x1868815139868032:12345-0@lo:101: 00010000:00010000:2.0:1782241089.799155:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241089.799172:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000077971168/0xc9959f2fb1e192c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e192be expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241089.799209:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000077971168/0xc9959f2fb1e192c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e192be expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241089.799219:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000077971168/0xc9959f2fb1e192c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e192be expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241089.799228:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000077971168, rc 0) 00000100:00100000:2.0:1782241089.799296:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3c02ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+12:6508:x1868815139868032:12345-0@lo:101: Request processed in 158us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241089.799303:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782241089.799453:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000dc79a0b1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139868032:0@lo:101: 00010000:00010000:3.0:1782241089.799470:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 00000000a1e7bc7b/0xc9959f2fb1e192be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e192c5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241089.799479:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 00000000a1e7bc7b/0xc9959f2fb1e192be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e192c5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241089.799536:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000097f0fca6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139868160:0@lo:256: 00000100:00100000:3.0:1782241089.799574:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241089.799606:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 000000007d5831c5 going to sleep for 11 seconds 00000100:00100000:2.0:1782241089.799685:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139868160 00000100:00100000:2.0:1782241089.799690:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139868160 00000100:00100000:2.0:1782241089.799736:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782241089.799742:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ae1de58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+12:6508:x1868815139868160:12345-0@lo:256: 20000000:01000000:2.0:1782241089.799804:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782241089.799820:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782241089.799823:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1782241089.799895:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ae1de58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+12:6508:x1868815139868160:12345-0@lo:256: Request processed in 153us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241089.799902:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782241089.800225:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000097f0fca6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139868160:0@lo:256: 10000000:01000000:1.0:1782241089.800269:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782241089.800276:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 00000000a1e7bc7b/0xc9959f2fb1e192be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e192c5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241089.800289:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 00000000a1e7bc7b/0xc9959f2fb1e192be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e192c5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241090.181953:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241091.205904:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782241091.727680:0:6941:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782241091.728263:0:6941:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782241092.229321:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241093.253007:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241093.893629:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241093.893652:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000053dbdeb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139868288:0@lo:400: 00000100:00100000:3.0:1782241093.893731:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241093.893801:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139868288 00000100:00100000:1.0:1782241093.893810:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139868288 00000100:00100000:3.0:1782241093.893850:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ef60c792 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139868416:0@lo:400: 00000100:00100000:1.0:1782241093.893864:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782241093.893877:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061aac8ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+12:3639:x1868815139868288:12345-0@lo:400: 00000100:00100000:3.0:1782241093.893902:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241093.893956:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061aac8ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+12:3639:x1868815139868288:12345-0@lo:400: Request processed in 66us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241093.893959:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139868416 00000100:00100000:3.0:1782241093.893964:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139868416 00000100:00100000:1.0:1782241093.893968:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782241093.894007:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782241093.894014:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038d53d82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139868416:12345-0@lo:400: 00000100:00100000:3.0:1782241093.894061:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038d53d82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139868416:12345-0@lo:400: Request processed in 49us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241093.894068:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782241093.894104:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000053dbdeb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139868288:0@lo:400: 00010000:00080000:1.0:1782241093.894167:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ef60c792 x1868815139868416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241093.894179:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ef60c792 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139868416:0@lo:400: 00010000:00010000:3.0:1782241094.277084:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241095.308002:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241096.329869:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241097.349071:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241098.373281:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241099.013127:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000053dbdeb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139868544:0@lo:400: 00000100:00100000:3.0:1782241099.013355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241099.013417:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a7e01f97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815139868672:0@lo:400: 00000100:00100000:3.0:1782241099.013446:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241099.013480:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139868544 00000100:00100000:3.0:1782241099.013487:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139868544 00000100:00100000:3.0:1782241099.013530:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782241099.013538:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ce14c86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+12:3638:x1868815139868544:12345-0@lo:400: 00000100:00100000:3.0:1782241099.013595:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ce14c86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+12:3638:x1868815139868544:12345-0@lo:400: Request processed in 57us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241099.013602:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782241099.013644:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000053dbdeb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139868544:0@lo:400: 00000100:00100000:2.0:1782241099.014913:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139868672 00000100:00100000:2.0:1782241099.014919:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139868672 00000100:00100000:2.0:1782241099.014963:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241099.014970:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001993ebd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815139868672:12345-0@lo:400: 00000100:00100000:2.0:1782241099.015026:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001993ebd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815139868672:12345-0@lo:400: Request processed in 57us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241099.015032:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782241099.015430:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a7e01f97 x1868815139868672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241099.015444:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a7e01f97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815139868672:0@lo:400: 00010000:00010000:0.0:1782241099.396889:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241100.426782:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782241100.605740:0:7440:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782241100.605745:0:7440:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1782241100.605746:0:7440:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1782241100.605937:0:7440:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000f8f955a5 00000020:01000004:3.0:1782241100.605955:0:7440:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1782241100.605966:0:7440:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1782241100.605979:0:7440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000488bed09) 00000020:00000080:3.0:1782241100.605995:0:7440:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1782241100.665536:0:7440:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1782241100.665624:0:7440:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1782241100.693710:0:7440:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1782241100.694938:0:7440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1782241100.694949:0:7440:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782241100.694959:0:7440:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e192d3 00000020:01000004:3.0:1782241100.694966:0:7440:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1782241100.694986:0:7440:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.158@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782241100.694989:0:7440:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782241100.694994:0:7440:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1782241100.695023:0:7440:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1782241100.695026:0:7440:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.158@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1782241100.716655:0:7440:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.158@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782241100.716695:0:7440:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.158@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1782241100.716699:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782241100.716701:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782241100.716703:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241100.716704:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241100.716705:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241100.716706:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241100.716708:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241100.716709:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782241100.716711:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782241100.716712:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241100.716713:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782241100.716717:0:7440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1782241100.716934:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782241100.716936:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782241100.716937:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241100.716938:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241100.716945:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241100.716946:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241100.716947:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241100.716948:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782241100.716949:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782241100.716950:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241100.716950:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782241100.716978:0:7440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1782241100.716994:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a7e01f97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139868800:0@lo:253: 00000100:00100000:3.0:1782241100.717076:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241100.717167:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 00000000adba5072 going to sleep for 11 seconds 00000100:00100000:1.0:1782241100.717208:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139868800 00000100:00100000:1.0:1782241100.717216:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139868800 00000100:00100000:1.0:1782241100.717298:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782241100.717307:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c615c33a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+12:7440:x1868815139868800:12345-0@lo:253: 20000000:01000000:1.0:1782241100.717336:0:6504:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1782241100.717340:0:6504:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1782241100.717344:0:6504:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1782241100.717348:0:6504:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1782241100.717383:0:6504:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1782241100.717593:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782241100.717730:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1782241100.717749:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1782241100.717800:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1782241100.717817:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1782241100.717832:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1782241100.717883:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1782241100.717890:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1782241100.717902:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1782241100.717907:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1782241100.717918:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1782241100.717922:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1782241100.717932:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1782241100.717946:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1782241100.718041:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1782241100.718049:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.158@tcp (null) (null) (null) 00000040:00080000:1.0:1782241100.718064:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1782241100.718070:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1782241100.718082:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1782241100.718088:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.158@tcp (null) (null) 00000040:00080000:1.0:1782241100.718098:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1782241100.718103:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1782241100.718114:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1782241100.718126:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1782241100.718135:0:6504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1782241100.718205:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1782241100.718214:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1782241100.718227:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1782241100.718242:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1782241100.718257:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1782241100.718263:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1782241100.718273:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1782241100.718303:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1782241100.718309:0:6504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1782241100.718329:0:6504:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1782241100.718336:0:6504:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1782241100.719029:0:7446:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1782241100.719248:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1782241100.719271:0:6504:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.158@tcp for mdt 20000000:01000000:2.0:1782241100.719273:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.158@tcp (null) (null) (null) 00000040:00080000:2.0:1782241100.719288:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1782241100.719296:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1782241100.719308:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1782241100.719314:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.158@tcp (null) (null) 00000040:00080000:2.0:1782241100.719330:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1782241100.719337:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1782241100.719350:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1782241100.719365:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1782241100.719410:0:6504:0:(mgs_llog.c:3426:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1782241100.719418:0:6504:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1782241100.720422:0:7447:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1782241100.720640:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1782241100.720662:0:6504:0:(mgs_llog.c:3484:mgs_write_log_osp_to_mdt()) add nid 192.168.204.158@tcp for mdt 20000000:01000000:2.0:1782241100.720664:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.158@tcp (null) (null) (null) 00000040:00080000:2.0:1782241100.720691:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1782241100.720698:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782241100.720711:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1782241100.720716:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.158@tcp (null) (null) 00000040:00080000:2.0:1782241100.720961:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1782241100.720971:0:6504:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1782241100.720984:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1782241100.720998:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1782241100.721018:0:6504:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1782241100.721021:0:6504:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1782241100.721025:0:6504:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1782241100.721071:0:6504:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1782241100.721074:0:6504:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782241100.721378:0:7448:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1782241100.721399:0:7448:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1782241100.721416:0:7448:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1782241100.721579:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1782241100.721599:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1782241100.721620:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1782241100.721629:0:6504:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1782241100.721631:0:6504:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782241100.722119:0:7449:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1782241100.722139:0:7449:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1782241100.722154:0:7449:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1782241100.722300:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1782241100.722320:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1782241100.722332:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1782241100.722341:0:6504:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1782241100.722343:0:6504:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782241100.722648:0:7450:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1782241100.722665:0:7450:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1782241100.722697:0:7450:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1782241100.723053:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1782241100.723074:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1782241100.723092:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1782241100.723105:0:6504:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1782241100.723108:0:6504:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1782241100.723112:0:6504:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1782241100.723119:0:6504:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1782241100.723411:0:7451:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1782241100.723510:0:6504:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1782241100.732221:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782241100.732393:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007462799f/0xc9959f2fb1e192da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.732414:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000949ffbd5/0xc9959f2fb1e1920f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19208 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.732420:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000af5b57da/0xc9959f2fb1e1922b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19224 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.732426:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007b6b3654/0xc9959f2fb1e1929b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19294 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.732433:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007462799f/0xc9959f2fb1e192da lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.732488:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007b6b3654/0xc9959f2fb1e1929b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19294 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.732503:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007b6b3654/0xc9959f2fb1e1929b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19294 expref: 12 pid: 6505 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241100.732518:0:6504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007ab81772 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1868815139868928:0@lo:104: 00000100:00100000:1.0:1782241100.732592:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782241100.732693:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000af5b57da/0xc9959f2fb1e1922b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19224 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.732701:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000af5b57da/0xc9959f2fb1e1922b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19224 expref: 12 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241100.732708:0:6504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008f87edf3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1868815139869056:0@lo:104: 00000100:00100000:1.0:1782241100.732743:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782241100.733089:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000949ffbd5/0xc9959f2fb1e1920f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19208 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.733097:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000949ffbd5/0xc9959f2fb1e1920f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19208 expref: 12 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241100.733105:0:6504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1868815139869184:0@lo:104: 00000100:00100000:1.0:1782241100.733128:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241100.733421:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139868928 00000100:00100000:0.0:1782241100.733429:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139868928 00000100:00100000:3.0:1782241100.733485:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139869056 00000100:00100000:3.0:1782241100.733489:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139869056 00000100:00100000:3.0:1782241100.733510:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782241100.733517:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b1acf5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:6504:x1868815139868928:12345-0@lo:104: 00010000:00010000:3.0:1782241100.733529:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: 000000009b49ce59/0xc9959f2fb1e19294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1929b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.733600:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782241100.733605:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b1acf5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:6504:x1868815139868928:12345-0@lo:104: Request processed in 88us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241100.733612:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782241100.733630:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782241100.733635:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c24e9c47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:6504:x1868815139869056:12345-0@lo:104: 00010000:00010000:3.0:1782241100.733642:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: 00000000ae062131/0xc9959f2fb1e19224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1922b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.733675:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782241100.733679:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c24e9c47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:6504:x1868815139869056:12345-0@lo:104: Request processed in 45us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241100.733684:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1782241100.733710:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241100.733714:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: 000000009b49ce59/0xc9959f2fb1e19294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1929b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.733734:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009b49ce59 already unused, calling callback (000000002488b196) 10000000:00010000:3.0:1782241100.733737:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: 000000009b49ce59/0xc9959f2fb1e19294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1929b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.733745:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: 000000009b49ce59/0xc9959f2fb1e19294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1929b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241100.733753:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: 000000009b49ce59/0xc9959f2fb1e19294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1929b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241100.733783:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241100.733813:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: 000000009b49ce59/0xc9959f2fb1e19294 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1929b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.733821:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241100.733837:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: 000000009b49ce59/0xc9959f2fb1e19294 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1929b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.733843:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: 000000009b49ce59/0xc9959f2fb1e19294 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1929b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.733859:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241100.733862:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: 00000000ae062131/0xc9959f2fb1e19224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1922b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.733867:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ae062131 already unused, calling callback (000000002488b196) 10000000:00010000:3.0:1782241100.733869:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: 00000000ae062131/0xc9959f2fb1e19224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1922b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.733880:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: 00000000ae062131/0xc9959f2fb1e19224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1922b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241100.733885:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: 00000000ae062131/0xc9959f2fb1e19224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1922b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241100.733890:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241100.733903:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: 00000000ae062131/0xc9959f2fb1e19224 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1922b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.733909:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241100.733921:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: 00000000ae062131/0xc9959f2fb1e19224 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1922b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.733928:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: 00000000ae062131/0xc9959f2fb1e19224 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1922b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.733938:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241100.733939:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241100.733941:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241100.733952:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000053dbdeb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139869312:0@lo:103: 00000100:00100000:3.0:1782241100.733983:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241100.734030:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000042127a50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139869440:0@lo:103: 00000100:00100000:3.0:1782241100.734052:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241100.734638:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241100.734652:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139869312 00000100:00100000:2.0:1782241100.734658:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139869312 00010000:00010000:2.0:1782241100.734685:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007b6b3654/0xc9959f2fb1e1929b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19294 expref: 13 pid: 6505 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241100.734715:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139869440 00000100:00100000:2.0:1782241100.734718:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139869440 00010000:00010000:2.0:1782241100.734728:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000af5b57da/0xc9959f2fb1e1922b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19224 expref: 14 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241100.734742:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241100.734748:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006763e8b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+14:3640:x1868815139869312:12345-0@lo:103: 00010000:00010000:2.0:1782241100.734778:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241100.734783:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007b6b3654/0xc9959f2fb1e1929b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19294 expref: 14 pid: 6505 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.734793:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007b6b3654/0xc9959f2fb1e1929b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19294 expref: 14 pid: 6505 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.734809:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241100.734846:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006763e8b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+14:3640:x1868815139869312:12345-0@lo:103: Request processed in 98us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241100.734853:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241100.734867:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782241100.734872:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a8639f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+13:3637:x1868815139869440:12345-0@lo:103: 00010000:00010000:2.0:1782241100.734879:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241100.734882:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000af5b57da/0xc9959f2fb1e1922b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19224 expref: 13 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.734897:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000af5b57da/0xc9959f2fb1e1922b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19224 expref: 13 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.734908:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241100.734935:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a8639f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+13:3637:x1868815139869440:12345-0@lo:103: Request processed in 63us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241100.734941:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782241100.734976:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000042127a50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139869440:0@lo:103: 00000100:00100000:2.0:1782241100.735016:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000053dbdeb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139869312:0@lo:103: 00000100:00100000:2.0:1782241100.735057:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139869184 00000100:00100000:2.0:1782241100.735060:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139869184 00000100:00100000:2.0:1782241100.735078:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782241100.735083:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c2e5fa2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:6504:x1868815139869184:12345-0@lo:104: 00010000:00010000:2.0:1782241100.735091:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: 000000006427a263/0xc9959f2fb1e19208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1920f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241100.735323:0:6504:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b4d69e31 going to sleep for 11 seconds 00010000:00010000:1.0:1782241100.735339:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007b6b3654/0xc9959f2fb1e1929b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19294 expref: 12 pid: 6505 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.735350:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782241100.735351:0:6504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007ab81772 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1868815139868928:0@lo:104: 00000100:00100000:2.0:1782241100.735354:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c2e5fa2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:6504:x1868815139869184:12345-0@lo:104: Request processed in 272us (2227us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241100.735361:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1782241100.735370:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000af5b57da/0xc9959f2fb1e1922b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19224 expref: 11 pid: 6503 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241100.735379:0:6504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008f87edf3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1868815139869056:0@lo:104: 00000100:00100000:1.0:1782241100.735387:0:6504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1868815139869184:0@lo:104: 00010000:00010000:3.0:1782241100.735393:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241100.735397:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: 000000006427a263/0xc9959f2fb1e19208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1920f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.735403:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006427a263 already unused, calling callback (000000002488b196) 00010000:00010000:1.0:1782241100.735403:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007462799f/0xc9959f2fb1e192da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241100.735411:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: 000000006427a263/0xc9959f2fb1e19208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1920f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.735418:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: 000000006427a263/0xc9959f2fb1e19208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1920f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241100.735423:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: 000000006427a263/0xc9959f2fb1e19208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1920f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241100.735429:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241100.735454:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: 000000006427a263/0xc9959f2fb1e19208 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1920f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.735460:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782241100.735507:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005e0cb91a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139869568:0@lo:103: 00000100:00100000:0.0:1782241100.735601:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782241100.735667:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: 000000006427a263/0xc9959f2fb1e19208 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1920f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.735675:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: 000000006427a263/0xc9959f2fb1e19208 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1920f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.735694:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241100.735696:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241100.735697:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241100.735697:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139869568 00000100:00100000:2.0:1782241100.735701:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139869568 00010000:00010000:2.0:1782241100.735715:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000949ffbd5/0xc9959f2fb1e1920f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19208 expref: 11 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241100.735740:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782241100.735746:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000378700d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+11:3638:x1868815139869568:12345-0@lo:103: 00010000:00010000:2.0:1782241100.735854:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241100.735863:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000949ffbd5/0xc9959f2fb1e1920f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19208 expref: 11 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.735917:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000949ffbd5/0xc9959f2fb1e1920f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19208 expref: 11 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.735931:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000949ffbd5/0xc9959f2fb1e1920f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19208 expref: 11 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.735941:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007462799f/0xc9959f2fb1e192da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.735981:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007462799f/0xc9959f2fb1e192da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.736023:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007462799f/0xc9959f2fb1e192da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.736031:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007462799f/0xc9959f2fb1e192da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.736038:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007462799f/0xc9959f2fb1e192da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.736054:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007462799f/0xc9959f2fb1e192da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.736061:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007462799f already unused, calling callback (00000000a921267b) 00010000:00010000:2.0:1782241100.736064:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007462799f/0xc9959f2fb1e192da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.736135:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007462799f/0xc9959f2fb1e192da lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.736154:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007462799f/0xc9959f2fb1e192da lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.736163:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241100.736247:0:6504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007462799f/0xc9959f2fb1e192da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.736255:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007462799f/0xc9959f2fb1e192da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.736260:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007462799f/0xc9959f2fb1e192da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782241100.736275:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1782241100.736361:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000378700d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+10:3638:x1868815139869568:12345-0@lo:103: Request processed in 615us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241100.736368:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782241100.736413:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005e0cb91a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139869568:0@lo:103: 00000100:00100000:1.0:1782241100.738614:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c615c33a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+9:7440:x1868815139868800:12345-0@lo:253: Request processed in 21301us (21531us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.738629:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782241100.738746:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a7e01f97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139868800:0@lo:253: 10000000:01000000:3.0:1782241100.739262:0:7440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1782241100.739266:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782241100.739268:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782241100.739269:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241100.739270:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1782241100.739271:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241100.739272:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241100.739274:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241100.739285:0:7440:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782241100.739287:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241100.739288:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782241100.739314:0:7440:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f8f955a5 from lustre-MDT0001 10000000:01000000:3.0:1782241100.739349:0:7440:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1782241100.739353:0:7440:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1782241100.739360:0:7440:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff890e43633380 local copy 10000000:01000000:3.0:1782241100.739364:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782241100.739398:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e192e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.739408:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e192e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.739416:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e192e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241100.739433:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a7e01f97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139869696:0@lo:101: 00000100:00100000:3.0:1782241100.739477:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241100.739605:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 00000000025ef73d going to sleep for 11 seconds 00000100:00100000:0.0:1782241100.739644:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139869696 00000100:00100000:0.0:1782241100.739651:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139869696 00000100:00100000:0.0:1782241100.739734:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782241100.739742:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf71a200 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+9:7440:x1868815139869696:12345-0@lo:101: 00010000:00010000:0.0:1782241100.739831:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241100.739844:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a2b58e93/0xc9959f2fb1e192e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e192e1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241100.739866:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a2b58e93/0xc9959f2fb1e192e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e192e1 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241100.739874:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a2b58e93/0xc9959f2fb1e192e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e192e1 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241100.739882:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a2b58e93, rc 0) 00000100:00100000:0.0:1782241100.740022:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf71a200 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+10:7440:x1868815139869696:12345-0@lo:101: Request processed in 281us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241100.740029:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782241100.740139:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a7e01f97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139869696:0@lo:101: 00010000:00010000:2.0:1782241100.740151:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e192e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc9959f2fb1e192e8 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.740159:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e192e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc9959f2fb1e192e8 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241100.740248:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002056d4ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139869824:0@lo:501: 00000100:00100000:2.0:1782241100.740275:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241100.740304:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 000000004cca98e6 going to sleep for 11 seconds 00000100:00100000:3.0:1782241100.740482:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139869824 00000100:00100000:3.0:1782241100.740487:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139869824 00000100:00100000:3.0:1782241100.740519:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782241100.740526:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055cd7219 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+10:7440:x1868815139869824:12345-0@lo:501: 00000100:00100000:3.0:1782241100.740604:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055cd7219 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+10:7440:x1868815139869824:12345-0@lo:501: Request processed in 78us (328us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782241100.740611:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782241100.740673:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002056d4ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139869824:0@lo:501: 10000000:01000000:1.0:1782241100.740685:0:7440:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782241100.740706:0:7440:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782241100.740710:0:7440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e192e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc9959f2fb1e192e8 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.740728:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e192e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc9959f2fb1e192e8 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.740742:0:7440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e192e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc9959f2fb1e192e8 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.740784:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782241100.740805:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff890e43609000 10000000:01000000:1.0:1782241100.740810:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782241100.740814:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff890e43633380 10000000:01000000:1.0:1782241100.740816:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1782241100.740819:0:7440:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff890e43633380 from 1 10000000:01000000:1.0:1782241100.740822:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782241100.740839:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 000000005c2d2154/0xc9959f2fb1e192ef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.740846:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 000000005c2d2154/0xc9959f2fb1e192ef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.740854:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 000000005c2d2154/0xc9959f2fb1e192ef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241100.740864:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139869952:0@lo:101: 00000100:00100000:1.0:1782241100.740891:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241100.740907:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 00000000be4f6f80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241100.740921:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139869952 00000100:00100000:1.0:1782241100.740936:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139869952 00000100:00100000:1.0:1782241100.740958:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782241100.740963:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014576810 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+10:7440:x1868815139869952:12345-0@lo:101: 00010000:00010000:1.0:1782241100.740971:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241100.740979:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d4953d65/0xc9959f2fb1e192f6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e192ef expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741002:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d4953d65/0xc9959f2fb1e192f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e192ef expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741010:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d4953d65/0xc9959f2fb1e192f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e192ef expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741017:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d4953d65, rc 0) 00000100:00100000:1.0:1782241100.741043:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014576810 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+11:7440:x1868815139869952:12345-0@lo:101: Request processed in 80us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.741050:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782241100.741081:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139869952:0@lo:101: 00010000:00010000:1.0:1782241100.741091:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 000000005c2d2154/0xc9959f2fb1e192ef lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e192f6 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741097:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 000000005c2d2154/0xc9959f2fb1e192ef lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e192f6 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241100.741109:0:7440:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782241100.741117:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 000000005c2d2154/0xc9959f2fb1e192ef lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e192f6 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741123:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 000000005c2d2154/0xc9959f2fb1e192ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e192f6 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241100.741130:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff890e43609000 10000000:01000000:1.0:1782241100.741143:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1782241100.741146:0:7440:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff890e43609000 from 1 10000000:01000000:1.0:1782241100.741153:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1782241100.741179:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 0000000032291014/0xc9959f2fb1e192fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741186:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 0000000032291014/0xc9959f2fb1e192fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741192:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 0000000032291014/0xc9959f2fb1e192fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241100.741205:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139870080:0@lo:101: 00000100:00100000:1.0:1782241100.741229:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241100.741241:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 00000000be4f6f80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241100.741253:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139870080 00000100:00100000:1.0:1782241100.741256:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139870080 00000100:00100000:1.0:1782241100.741274:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782241100.741277:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cdfee30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+11:7440:x1868815139870080:12345-0@lo:101: 00010000:00010000:1.0:1782241100.741284:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241100.741290:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e62a7885/0xc9959f2fb1e19304 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e192fd expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741302:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e62a7885/0xc9959f2fb1e19304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e192fd expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741310:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e62a7885/0xc9959f2fb1e19304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e192fd expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741316:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e62a7885, rc 0) 00000100:00100000:1.0:1782241100.741340:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cdfee30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+12:7440:x1868815139870080:12345-0@lo:101: Request processed in 61us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.741354:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782241100.741384:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139870080:0@lo:101: 00010000:00010000:1.0:1782241100.741392:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 0000000032291014/0xc9959f2fb1e192fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19304 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741399:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 0000000032291014/0xc9959f2fb1e192fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19304 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241100.741407:0:7440:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1782241100.741414:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 0000000032291014/0xc9959f2fb1e192fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19304 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741420:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 0000000032291014/0xc9959f2fb1e192fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19304 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241100.741425:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1782241100.741438:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782241100.741442:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff890e43609000 10000000:01000000:1.0:1782241100.741444:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1782241100.741447:0:7440:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1782241100.741448:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1782241100.741460:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 00000000e95febcd/0xc9959f2fb1e1930b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741466:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 00000000e95febcd/0xc9959f2fb1e1930b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741473:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 00000000e95febcd/0xc9959f2fb1e1930b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241100.741492:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139870208:0@lo:101: 00000100:00100000:1.0:1782241100.741516:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241100.741529:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 00000000be4f6f80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241100.741556:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139870208 00000100:00100000:1.0:1782241100.741560:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139870208 00000100:00100000:1.0:1782241100.741579:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782241100.741584:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df397027 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+12:7440:x1868815139870208:12345-0@lo:101: 00010000:00010000:1.0:1782241100.741590:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241100.741597:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f97acc2f/0xc9959f2fb1e19312 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1930b expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741608:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f97acc2f/0xc9959f2fb1e19312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1930b expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741615:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f97acc2f/0xc9959f2fb1e19312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1930b expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741621:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f97acc2f, rc 0) 00000100:00100000:1.0:1782241100.741646:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df397027 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+13:7440:x1868815139870208:12345-0@lo:101: Request processed in 61us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.741652:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782241100.741680:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139870208:0@lo:101: 00010000:00010000:1.0:1782241100.741688:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 00000000e95febcd/0xc9959f2fb1e1930b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19312 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.741695:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 00000000e95febcd/0xc9959f2fb1e1930b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19312 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241100.741791:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139870336:0@lo:501: 00000100:00100000:1.0:1782241100.741814:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241100.741827:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 00000000be4f6f80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241100.741840:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139870336 00000100:00100000:1.0:1782241100.741843:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139870336 00000100:00100000:1.0:1782241100.741860:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782241100.741865:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fb2bbe8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+13:7440:x1868815139870336:12345-0@lo:501: 00000100:00100000:1.0:1782241100.741953:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fb2bbe8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+13:7440:x1868815139870336:12345-0@lo:501: Request processed in 88us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.741960:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782241100.741989:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139870336:0@lo:501: 00000100:00100000:1.0:1782241100.742015:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139870464:0@lo:503: 00000100:00100000:1.0:1782241100.742053:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241100.742066:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 00000000be4f6f80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241100.742079:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139870464 00000100:00100000:1.0:1782241100.742082:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139870464 00000100:00100000:1.0:1782241100.742098:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782241100.742102:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2c77fa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+13:7440:x1868815139870464:12345-0@lo:503: 00000100:00100000:1.0:1782241100.742177:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2c77fa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+13:7440:x1868815139870464:12345-0@lo:503: Request processed in 73us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.742183:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782241100.742220:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139870464:0@lo:503: 00000040:00080000:1.0:1782241100.742451:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782241100.742519:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139870592:0@lo:502: 00000100:00100000:1.0:1782241100.742569:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241100.742583:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 00000000be4f6f80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241100.742597:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139870592 00000100:00100000:1.0:1782241100.742600:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139870592 00000100:00100000:1.0:1782241100.742617:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782241100.742622:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9eaeae1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+13:7440:x1868815139870592:12345-0@lo:502: 00000100:00100000:1.0:1782241100.742699:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9eaeae1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+13:7440:x1868815139870592:12345-0@lo:502: Request processed in 77us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.742707:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782241100.742741:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139870592:0@lo:502: 00000040:00080000:1.0:1782241100.742949:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1782241100.742975:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1782241100.742988:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1782241100.743001:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1782241100.743014:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1782241100.743027:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1782241100.743038:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1782241100.743050:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1782241100.743063:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1782241100.743074:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1782241100.743087:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1782241100.743098:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1782241100.743110:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1782241100.743121:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1782241100.743132:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1782241100.743144:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1782241100.743155:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1782241100.743167:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1782241100.743177:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1782241100.743204:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1782241100.743227:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1782241100.743240:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1782241100.743253:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1782241100.743274:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139870720:0@lo:502: 00000100:00100000:1.0:1782241100.743309:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241100.743324:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 00000000be4f6f80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241100.743339:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139870720 00000100:00100000:1.0:1782241100.743343:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139870720 00000100:00100000:1.0:1782241100.743362:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782241100.743367:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9d7a74f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+13:7440:x1868815139870720:12345-0@lo:502: 00000100:00100000:1.0:1782241100.743429:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9d7a74f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+13:7440:x1868815139870720:12345-0@lo:502: Request processed in 62us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.743436:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782241100.743470:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139870720:0@lo:502: 00000040:00080000:1.0:1782241100.743502:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1782241100.743509:0:7440:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00010000:00010000:3.0:1782241100.743809:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241100.743816:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e192e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc9959f2fb1e192e8 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.743838:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001343e1eb already unused, calling callback (000000002488b196) 10000000:00010000:3.0:1782241100.743841:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e192e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc9959f2fb1e192e8 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.743851:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e192e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc9959f2fb1e192e8 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241100.743857:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e192e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc9959f2fb1e192e8 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241100.743862:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241100.743883:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e192e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc9959f2fb1e192e8 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.743890:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241100.743907:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e192e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc9959f2fb1e192e8 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.743913:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e192e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc9959f2fb1e192e8 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.743937:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241100.743939:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241100.743940:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241100.743949:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cbe91164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139870848:0@lo:103: 00000100:00100000:3.0:1782241100.743978:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241100.744263:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139870848 00000100:00100000:0.0:1782241100.744269:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139870848 00000100:00100000:0.0:1782241100.744336:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782241100.744343:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092a8aba0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+13:3639:x1868815139870848:12345-0@lo:103: 00010000:00010000:0.0:1782241100.744353:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241100.744367:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a2b58e93/0xc9959f2fb1e192e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e192e1 expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241100.744380:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241100.744418:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092a8aba0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+12:3639:x1868815139870848:12345-0@lo:103: Request processed in 76us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241100.744425:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241100.744715:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cbe91164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139870848:0@lo:103: 00000020:01000000:1.0:1782241100.745080:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241100.745092:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241100.745094:0:7452:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1782241100.745100:0:7452:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1782241100.745102:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782241100.745114:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000dc740d8f) 00000020:00000080:1.0:1782241100.745133:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1782241100.745138:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1782241100.745220:0:7452:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782241100.745228:0:7452:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e19320 00000020:00000080:1.0:1782241100.745436:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1782241100.745441:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241100.745445:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241100.745446:0:7452:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1782241100.745456:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241100.745460:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241100.745461:0:7452:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1782241100.745464:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782241100.745480:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000003eaf56a1) 00000020:00000080:1.0:1782241100.745494:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1782241100.745500:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1782241100.745502:0:7452:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1782241100.745504:0:7452:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1782241100.745510:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782241100.745575:0:7452:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f8f955a5 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1782241100.745590:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000442a3df5) 00000020:00000080:1.0:1782241100.745599:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1782241100.745679:0:7452:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1782241100.745685:0:7452:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e19335 00000020:00000080:1.0:1782241100.745992:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1782241100.746000:0:7452:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1782241100.746005:0:7452:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc9959f2fb1e1933c 00080000:01000000:1.0:1782241100.746011:0:7452:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1782241100.746014:0:7452:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e19343 00080000:10000000:1.0:1782241100.746390:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1782241100.746515:0:7452:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1782241100.820746:0:7452:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1782241100.821185:0:7452:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1782241100.824155:0:7452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1782241100.824561:0:7452:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1782241100.835327:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1782241100.835345:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241100.835353:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241100.835356:0:7452:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1782241100.835366:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241100.835375:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241100.835377:0:7452:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1782241100.835380:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782241100.835386:0:7452:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:00000080:2.0:1782241100.835419:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782241100.835444:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000a39663bb) 00000020:00000080:2.0:1782241100.835469:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1782241100.835476:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782241100.835609:0:7452:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1782241100.835617:0:7452:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1782241100.835625:0:7452:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e19351 00010000:00080000:2.0:1782241100.835658:0:7452:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009947166b@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.158@tcp at head 00010000:00010000:2.0:1782241100.843968:0:7452:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1782241100.846211:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1782241100.846227:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1782241100.846278:0:7452:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1782241100.846300:0:7452:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e19358 00000100:00080000:2.0:1782241100.846312:0:7452:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782241100.846318:0:7452:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000009947166b using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241100.846353:0:7452:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e7035675 x1868815139870976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782241100.846374:0:7452:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1782241100.846419:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241100.846424:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241100.846425:0:7452:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1782241100.846428:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1782241100.846431:0:7452:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1782241100.846432:0:7452:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782241100.846433:0:7452:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782241100.846435:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1782241100.846443:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241100.846444:0:7452:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1782241100.846447:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241100.846453:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241100.846454:0:7452:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1782241100.846458:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1782241100.846490:0:7452:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1782241100.846504:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241100.846507:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241100.846509:0:7452:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1782241100.846511:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241100.846513:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241100.846515:0:7452:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782241100.846517:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782241100.846518:0:7452:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782241100.846556:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241100.846560:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241100.846562:0:7452:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782241100.846565:0:7452:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1782241100.846675:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e7035675 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815139870976:0@lo:38: 00000100:00100000:2.0:1782241100.846783:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1782241100.846873:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1782241100.846899:0:7440:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1782241100.846915:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 00000000e95febcd/0xc9959f2fb1e1930b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19312 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.846927:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 00000000e95febcd/0xc9959f2fb1e1930b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19312 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241100.846935:0:7440:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890e43609000 from 1 10000000:01000000:2.0:1782241100.846938:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782241100.846963:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 00000000949ffbd5/0xc9959f2fb1e1935f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.846977:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 00000000949ffbd5/0xc9959f2fb1e1935f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.846988:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 00000000949ffbd5/0xc9959f2fb1e1935f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241100.847001:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ab63903d pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139871232:0@lo:101: 00000100:00100000:2.0:1782241100.847032:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241100.847047:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ed743d02 going to sleep for 11 seconds 00000100:00100000:2.0:1782241100.847070:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139870976 00000100:00100000:2.0:1782241100.847076:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139870976 00000100:00100000:2.0:1782241100.847103:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241100.847110:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001d2e343 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815139870976:12345-0@lo:38: 00010000:00080000:2.0:1782241100.847130:0:6515:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:2.0:1782241100.847171:0:6515:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e19366 00000004:00100000:2.0:1782241100.847185:0:6515:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1782241100.847190:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1782241100.847260:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000009010b5c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139871104:0@lo:400: 00000100:00100000:2.0:1782241100.847291:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241100.847334:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139871232 00000100:00100000:2.0:1782241100.847338:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139871232 00000100:00100000:2.0:1782241100.847367:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782241100.847372:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d90fd731 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+12:7440:x1868815139871232:12345-0@lo:101: 00010000:00010000:2.0:1782241100.847383:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241100.847394:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000720aa7ab/0xc9959f2fb1e1936d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1935f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.847425:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000720aa7ab/0xc9959f2fb1e1936d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1935f expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.847434:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000720aa7ab/0xc9959f2fb1e1936d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1935f expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.847441:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000720aa7ab, rc 0) 00000100:00100000:2.0:1782241100.847476:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d90fd731 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+13:7440:x1868815139871232:12345-0@lo:101: Request processed in 103us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241100.847482:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782241100.847514:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139871104 00000100:00100000:2.0:1782241100.847518:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139871104 00000100:00100000:2.0:1782241100.847560:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782241100.847567:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010ddba33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139871104:12345-0@lo:400: 00000100:00100000:2.0:1782241100.847604:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010ddba33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139871104:12345-0@lo:400: Request processed in 38us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241100.847610:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782241100.847649:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009010b5c0 x1868815139871104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241100.847661:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000009010b5c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139871104:0@lo:400: 00000100:00100000:2.0:1782241100.847689:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ab63903d pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139871232:0@lo:101: 00010000:00010000:2.0:1782241100.847701:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 00000000949ffbd5/0xc9959f2fb1e1935f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1936d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.847709:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 00000000949ffbd5/0xc9959f2fb1e1935f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1936d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241100.848294:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ab63903d pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139871360:0@lo:256: 00000100:00100000:2.0:1782241100.848335:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241100.848360:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ed743d02 going to sleep for 11 seconds 00000100:00100000:0.0:1782241100.848858:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139871360 00000100:00100000:0.0:1782241100.848864:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139871360 00000100:00100000:0.0:1782241100.848900:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782241100.848906:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063d22599 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+13:7440:x1868815139871360:12345-0@lo:256: 20000000:01000000:0.0:1782241100.848923:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1782241100.848939:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782241100.848942:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1782241100.849035:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063d22599 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+13:7440:x1868815139871360:12345-0@lo:256: Request processed in 130us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241100.849043:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782241100.850383:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ab63903d pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139871360:0@lo:256: 10000000:01000000:3.0:1782241100.851066:0:7440:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782241100.853012:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 00000000949ffbd5/0xc9959f2fb1e1935f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1936d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.853026:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 00000000949ffbd5/0xc9959f2fb1e1935f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1936d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241100.853035:0:7440:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e43609000 from 1 10000000:01000000:3.0:1782241100.853037:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782241100.853079:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e19374 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.853086:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e19374 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.853096:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e19374 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241100.853121:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007afa6f4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139871488:0@lo:101: 00000100:00100000:3.0:1782241100.853188:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241100.853213:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d24d4d11 going to sleep for 11 seconds 00000100:00100000:2.0:1782241100.853463:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139871488 00000100:00100000:2.0:1782241100.853471:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139871488 00000100:00100000:2.0:1782241100.853559:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782241100.853567:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026a572c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+13:7440:x1868815139871488:12345-0@lo:101: 00010000:00010000:2.0:1782241100.853579:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241100.853591:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b4c8ef29/0xc9959f2fb1e1937b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19374 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.853613:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b4c8ef29/0xc9959f2fb1e1937b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19374 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.853621:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b4c8ef29/0xc9959f2fb1e1937b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19374 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.853628:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b4c8ef29, rc 0) 00000100:00100000:2.0:1782241100.853663:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026a572c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+14:7440:x1868815139871488:12345-0@lo:101: Request processed in 98us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241100.853670:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782241100.854218:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007afa6f4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139871488:0@lo:101: 00010000:00010000:3.0:1782241100.854235:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e19374 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1937b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.854243:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e19374 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1937b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241100.854387:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007afa6f4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139871616:0@lo:501: 00000100:00100000:3.0:1782241100.854421:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241100.855156:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d24d4d11 going to sleep for 11 seconds 00000100:00100000:1.0:1782241100.855704:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139871616 00000100:00100000:1.0:1782241100.855712:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139871616 00000100:00080000:3.0:1782241100.856355:0:6515:0:(import.c:65:import_set_state_nolock()) 000000002e0f0456 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782241100.856428:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001d2e343 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1868815139870976:12345-0@lo:38: Request processed in 9316us (9670us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241100.856446:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241100.856647:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782241100.856656:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca64c78d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+14:7440:x1868815139871616:12345-0@lo:501: 00000100:00100000:3.0:1782241100.856847:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782241100.856857:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1782241100.856865:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1782241100.856869:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782241100.856871:0:3636:0:(import.c:65:import_set_state_nolock()) 000000009947166b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782241100.856884:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e7035675 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815139870976:0@lo:38: 00000100:00100000:1.0:1782241100.856997:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca64c78d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+14:7440:x1868815139871616:12345-0@lo:501: Request processed in 342us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.857004:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782241100.857088:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007afa6f4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139871616:0@lo:501: 00000100:00100000:3.0:1782241100.857149:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007afa6f4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139871744:0@lo:503: 00000100:00100000:3.0:1782241100.857191:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241100.857227:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d24d4d11 going to sleep for 11 seconds 00000100:00100000:1.0:1782241100.857332:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139871744 00000100:00100000:1.0:1782241100.857338:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139871744 00000100:00100000:1.0:1782241100.857356:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782241100.857369:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096fe9807 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+14:7440:x1868815139871744:12345-0@lo:503: 00000040:00080000:1.0:1782241100.857400:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782241100.857444:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096fe9807 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+14:7440:x1868815139871744:12345-0@lo:503: Request processed in 75us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.857450:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782241100.857527:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007afa6f4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139871744:0@lo:503: 00000040:00080000:3.0:1782241100.857932:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782241100.857990:0:7440:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1782241100.858074:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782241100.858425:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241100.858436:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000009010b5c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139871872:0@lo:41: 00000100:00100000:2.0:1782241100.858475:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241100.858515:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139871872 00000100:00100000:2.0:1782241100.858520:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139871872 00000100:00100000:2.0:1782241100.858566:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241100.858580:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005508014 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1868815139871872:12345-0@lo:41: 00000004:00000024:2.0:1782241100.858607:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1782241100.858646:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005508014 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1868815139871872:12345-0@lo:41: Request processed in 67us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241100.858651:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241100.858685:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000009010b5c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139871872:0@lo:41: 00000040:00080000:3.0:1782241100.859476:0:7457:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1782241100.859673:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1782241100.859702:0:7440:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782241100.859850:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e19374 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1937b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.859860:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e19374 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1937b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241100.859915:0:7440:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782241100.859917:0:7440:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff890e43609000 10000000:01000000:2.0:1782241100.859920:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff890e43609000 10000000:01000000:2.0:1782241100.859924:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782241100.859930:0:7440:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e43609000 from 1 10000000:01000000:2.0:1782241100.859932:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782241100.859962:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 00000000411f1d8d/0xc9959f2fb1e19382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.859969:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 00000000411f1d8d/0xc9959f2fb1e19382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.859977:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 00000000411f1d8d/0xc9959f2fb1e19382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241100.859994:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000009010b5c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139872000:0@lo:101: 00000100:00100000:2.0:1782241100.860050:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241100.860081:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 0000000027cc5000 going to sleep for 11 seconds 00000100:00100000:3.0:1782241100.860140:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139872000 00000100:00100000:3.0:1782241100.860146:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139872000 00000100:00100000:3.0:1782241100.860186:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782241100.860193:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dae9f20c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+14:7440:x1868815139872000:12345-0@lo:101: 00010000:00010000:3.0:1782241100.860204:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241100.860215:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000092bee130/0xc9959f2fb1e19389 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19382 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.860247:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000092bee130/0xc9959f2fb1e19389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19382 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.860331:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000092bee130/0xc9959f2fb1e19389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19382 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241100.860341:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000092bee130, rc 0) 00000100:00100000:3.0:1782241100.860376:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dae9f20c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:7440:x1868815139872000:12345-0@lo:101: Request processed in 184us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241100.860382:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782241100.860505:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000009010b5c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139872000:0@lo:101: 00010000:00010000:2.0:1782241100.860517:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 00000000411f1d8d/0xc9959f2fb1e19382 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19389 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.860526:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 00000000411f1d8d/0xc9959f2fb1e19382 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19389 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241100.860616:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000009010b5c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139872128:0@lo:501: 00000100:00100000:2.0:1782241100.860639:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241100.860659:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 0000000027cc5000 going to sleep for 11 seconds 00000100:00100000:2.0:1782241100.860673:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139872128 00000100:00100000:2.0:1782241100.860676:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139872128 00000100:00100000:2.0:1782241100.860706:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782241100.860712:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a83e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:7440:x1868815139872128:12345-0@lo:501: 00000100:00100000:2.0:1782241100.860889:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a83e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:7440:x1868815139872128:12345-0@lo:501: Request processed in 177us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241100.860896:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782241100.860927:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000009010b5c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139872128:0@lo:501: 00000100:00100000:2.0:1782241100.860951:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000009010b5c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139872256:0@lo:503: 00000100:00100000:2.0:1782241100.860986:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241100.861002:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 0000000027cc5000 going to sleep for 11 seconds 00000100:00100000:2.0:1782241100.861013:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139872256 00000100:00100000:2.0:1782241100.861016:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139872256 00000100:00100000:2.0:1782241100.861032:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782241100.861037:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c23ff95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:7440:x1868815139872256:12345-0@lo:503: 00000100:00100000:2.0:1782241100.861112:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c23ff95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:7440:x1868815139872256:12345-0@lo:503: Request processed in 74us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241100.861118:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782241100.861157:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000009010b5c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139872256:0@lo:503: 00000040:00080000:2.0:1782241100.861493:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782241100.861567:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000009010b5c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139872384:0@lo:502: 00000100:00100000:2.0:1782241100.861604:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241100.861619:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d660d6fc going to sleep for 11 seconds 00000100:00100000:2.0:1782241100.861634:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139872384 00000100:00100000:2.0:1782241100.861638:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139872384 00000100:00100000:2.0:1782241100.861656:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782241100.861661:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fa95df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:7440:x1868815139872384:12345-0@lo:502: 00000100:00100000:2.0:1782241100.861981:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fa95df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:7440:x1868815139872384:12345-0@lo:502: Request processed in 319us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241100.861988:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782241100.862168:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000009010b5c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139872384:0@lo:502: 00000040:00080000:0.0:1782241100.862495:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1782241100.862524:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1782241100.862549:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1782241100.862565:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1782241100.862588:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1782241100.862601:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1782241100.862612:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1782241100.862624:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1782241100.862635:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1782241100.862648:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1782241100.862659:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1782241100.862671:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1782241100.862682:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1782241100.862693:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1782241100.862704:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1782241100.862715:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1782241100.863022:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1782241100.863038:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1782241100.863051:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1782241100.863064:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1782241100.863076:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1782241100.863087:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1782241100.863097:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1782241100.863110:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1782241100.863123:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1782241100.863134:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1782241100.863144:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1782241100.863155:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1782241100.863184:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000590d5b6b pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139872512:0@lo:502: 00000100:00100000:0.0:1782241100.863234:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241100.863388:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 000000005843f51e going to sleep for 11 seconds 00000100:00100000:1.0:1782241100.863428:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139872512 00000100:00100000:1.0:1782241100.863434:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139872512 00000100:00100000:1.0:1782241100.863508:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782241100.863516:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034b097fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:7440:x1868815139872512:12345-0@lo:502: 00000100:00100000:1.0:1782241100.863670:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034b097fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:7440:x1868815139872512:12345-0@lo:502: Request processed in 155us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.863678:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782241100.863897:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000590d5b6b pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139872512:0@lo:502: 00000040:00080000:0.0:1782241100.863945:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1782241100.863954:0:7440:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1782241100.864444:0:7458:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1782241100.864460:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000d12a9d85) 00000020:00000080:3.0:1782241100.864480:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1782241100.864656:0:7458:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f8f955a5 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1782241100.864660:0:7458:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f8f955a5 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1782241100.864663:0:7458:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000f8f955a5 3 00010000:00080000:3.0:1782241100.864687:0:7458:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000adb6e77b@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.158@tcp at head 00010000:00010000:3.0:1782241100.868974:0:7458:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1782241100.869082:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1782241100.869128:0:7458:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782241100.869141:0:7458:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc9959f2fb1e19397 00000100:00080000:3.0:1782241100.869151:0:7458:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782241100.869156:0:7458:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000adb6e77b using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241100.869189:0:7458:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007afa6f4b x1868815139872640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782241100.869224:0:7458:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782241100.869431:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007afa6f4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1868815139872640:0@lo:38: 00000100:00100000:0.0:1782241100.869510:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241100.869611:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139872640 00000100:00100000:3.0:1782241100.869625:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139872640 00000100:00100000:3.0:1782241100.869663:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782241100.869669:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000590d5b6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1868815139872640:12345-0@lo:38: 00010000:00080000:3.0:1782241100.869691:0:6511:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:3.0:1782241100.869861:0:6511:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc9959f2fb1e1939e 00000004:00100000:3.0:1782241100.869875:0:6511:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782241100.869902:0:6511:0:(import.c:65:import_set_state_nolock()) 00000000adc585fb : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782241100.869992:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000590d5b6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1868815139872640:12345-0@lo:38: Request processed in 322us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241100.870000:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1782241100.870475:0:7458:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:1.0:1782241100.870653:0:7460:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:1.0:1782241100.871412:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1782241100.871446:0:7440:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782241100.871469:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 00000000411f1d8d/0xc9959f2fb1e19382 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19389 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.871480:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 00000000411f1d8d/0xc9959f2fb1e19382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19389 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782241100.871527:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782241100.871529:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1782241100.871531:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782241100.871532:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782241100.871533:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782241100.871535:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782241100.871544:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782241100.871545:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782241100.871547:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782241100.871548:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782241100.871554:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782241100.871558:0:7440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1782241100.871561:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782241100.871562:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1782241100.871563:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782241100.871564:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782241100.871565:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782241100.871566:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782241100.871567:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782241100.871568:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782241100.871569:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782241100.871570:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782241100.871570:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782241100.871590:0:7440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1782241100.871613:0:7440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139872768:0@lo:253: 00000100:00100000:1.0:1782241100.871664:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241100.871694:0:7440:0:(client.c:2701:ptlrpc_set_wait()) set 0000000009eef121 going to sleep for 11 seconds 00000100:00100000:3.0:1782241100.871746:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139872768 00000100:00100000:3.0:1782241100.871752:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139872768 00000100:00100000:3.0:1782241100.871815:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782241100.871823:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e47f6a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:7440:x1868815139872768:12345-0@lo:253: 20000000:01000000:3.0:1782241100.871846:0:6503:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1782241100.871859:0:6503:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1782241100.877059:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1782241100.877099:0:6503:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782241100.877107:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1782241100.877486:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e47f6a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:7440:x1868815139872768:12345-0@lo:253: Request processed in 5659us (5817us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.877499:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782241100.877606:0:7440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001707b1a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:7440:1868815139872768:0@lo:253: 10000000:01000000:3.0:1782241100.877620:0:7440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1782241100.877623:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782241100.877625:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782241100.877626:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241100.877627:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241100.877628:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241100.877629:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241100.877631:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241100.877633:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782241100.877634:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782241100.877635:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241100.877637:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782241100.877653:0:7440:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00080000:0.0:1782241100.878608:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007afa6f4b x1868815139872640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241100.878622:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782241100.878629:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1782241100.878638:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1782241100.878644:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782241100.878648:0:3636:0:(import.c:65:import_set_state_nolock()) 00000000adb6e77b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782241100.878655:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007afa6f4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1868815139872640:0@lo:38: 20000000:01000000:2.0:1782241100.878753:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782241100.878822:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782241100.878842:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000933adb91/0xc9959f2fb1e193a5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.878857:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000077971168/0xc9959f2fb1e192c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e192be expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.878865:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000720aa7ab/0xc9959f2fb1e1936d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1935f expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.878873:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000933adb91/0xc9959f2fb1e193a5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.878921:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000720aa7ab/0xc9959f2fb1e1936d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1935f expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.878936:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000720aa7ab/0xc9959f2fb1e1936d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1935f expref: 14 pid: 6504 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241100.878948:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005896fd17 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1868815139872896:0@lo:104: 00000100:00100000:2.0:1782241100.878996:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241100.879037:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000077971168/0xc9959f2fb1e192c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e192be expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.879044:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000077971168/0xc9959f2fb1e192c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e192be expref: 14 pid: 6503 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241100.879051:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d317c575 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1868815139873024:0@lo:104: 00000100:00100000:2.0:1782241100.879071:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241100.879164:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set 000000004cca98e6 going to sleep for 11 seconds 00000100:00100000:1.0:1782241100.881297:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139872896 00000100:00100000:1.0:1782241100.881310:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139872896 00000100:00100000:1.0:1782241100.881346:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139873024 00000100:00100000:1.0:1782241100.881349:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139873024 00000100:00100000:1.0:1782241100.881364:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782241100.881371:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089917664 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:6526:x1868815139872896:12345-0@lo:104: 00010000:00010000:1.0:1782241100.881387:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: 00000000949ffbd5/0xc9959f2fb1e1935f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1936d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.881476:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782241100.881493:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089917664 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:6526:x1868815139872896:12345-0@lo:104: Request processed in 122us (2497us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.881502:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782241100.881521:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782241100.881526:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a3bd0e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:6526:x1868815139873024:12345-0@lo:104: 00010000:00010000:1.0:1782241100.881533:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: 00000000a1e7bc7b/0xc9959f2fb1e192be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e192c5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.881584:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782241100.881588:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a3bd0e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:6526:x1868815139873024:12345-0@lo:104: Request processed in 63us (2518us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.881606:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1782241100.881624:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782241100.881629:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: 00000000949ffbd5/0xc9959f2fb1e1935f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1936d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.881635:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000949ffbd5 already unused, calling callback (000000002488b196) 10000000:00010000:1.0:1782241100.881638:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: 00000000949ffbd5/0xc9959f2fb1e1935f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1936d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.881645:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: 00000000949ffbd5/0xc9959f2fb1e1935f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1936d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241100.881651:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: 00000000949ffbd5/0xc9959f2fb1e1935f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1936d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241100.881656:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782241100.881834:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: 00000000949ffbd5/0xc9959f2fb1e1935f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1936d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.881850:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241100.881869:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: 00000000949ffbd5/0xc9959f2fb1e1935f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1936d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.881875:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: 00000000949ffbd5/0xc9959f2fb1e1935f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1936d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.881888:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241100.881890:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: 00000000a1e7bc7b/0xc9959f2fb1e192be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e192c5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.881896:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a1e7bc7b already unused, calling callback (000000002488b196) 10000000:00010000:1.0:1782241100.881898:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: 00000000a1e7bc7b/0xc9959f2fb1e192be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e192c5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.881904:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: 00000000a1e7bc7b/0xc9959f2fb1e192be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e192c5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241100.881909:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: 00000000a1e7bc7b/0xc9959f2fb1e192be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e192c5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241100.881914:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782241100.881926:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: 00000000a1e7bc7b/0xc9959f2fb1e192be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e192c5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.881932:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241100.881945:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: 00000000a1e7bc7b/0xc9959f2fb1e192be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e192c5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.881951:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: 00000000a1e7bc7b/0xc9959f2fb1e192be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e192c5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.881971:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241100.881973:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241100.881975:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241100.881981:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241100.882280:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008f87edf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139873152:0@lo:103: 00000100:00100000:1.0:1782241100.882324:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241100.882372:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007ab81772 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139873280:0@lo:103: 00000100:00100000:1.0:1782241100.882397:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241100.882435:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139873152 00000100:00100000:1.0:1782241100.882441:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139873152 00010000:00010000:1.0:1782241100.882458:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000720aa7ab/0xc9959f2fb1e1936d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1935f expref: 15 pid: 6504 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241100.882482:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139873280 00000100:00100000:1.0:1782241100.882485:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139873280 00010000:00010000:1.0:1782241100.882493:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000077971168/0xc9959f2fb1e192c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e192be expref: 16 pid: 6503 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241100.882504:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782241100.882510:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6a26d6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+16:3638:x1868815139873152:12345-0@lo:103: 00010000:00010000:1.0:1782241100.882519:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241100.882522:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000720aa7ab/0xc9959f2fb1e1936d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1935f expref: 16 pid: 6504 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.882532:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000720aa7ab/0xc9959f2fb1e1936d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1935f expref: 16 pid: 6504 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.882563:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241100.882596:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6a26d6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+16:3638:x1868815139873152:12345-0@lo:103: Request processed in 86us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.882602:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782241100.882616:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782241100.882627:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9ba752e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+15:3639:x1868815139873280:12345-0@lo:103: 00010000:00010000:1.0:1782241100.882634:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241100.882638:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000077971168/0xc9959f2fb1e192c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e192be expref: 15 pid: 6503 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.882645:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000077971168/0xc9959f2fb1e192c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e192be expref: 15 pid: 6503 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.882656:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000933adb91/0xc9959f2fb1e193a5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.882663:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000933adb91/0xc9959f2fb1e193a5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782241100.882677:0:6495:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004931395s 00010000:00010000:1.0:1782241100.882681:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000933adb91/0xc9959f2fb1e193a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.882712:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000720aa7ab/0xc9959f2fb1e1936d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1935f expref: 15 pid: 6504 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241100.882727:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005896fd17 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1868815139872896:0@lo:104: 00010000:00010000:2.0:1782241100.882737:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000077971168/0xc9959f2fb1e192c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e192be expref: 14 pid: 6503 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241100.882745:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d317c575 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1868815139873024:0@lo:104: 00010000:00010000:2.0:1782241100.882777:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000933adb91/0xc9959f2fb1e193a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.882797:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: 00000000933adb91/0xc9959f2fb1e193a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241100.882803:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000933adb91/0xc9959f2fb1e193a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.882820:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000933adb91/0xc9959f2fb1e193a5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.882827:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000933adb91/0xc9959f2fb1e193a5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.882832:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000933adb91/0xc9959f2fb1e193a5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.882837:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000933adb91 already unused, calling callback (00000000a921267b) 00010000:00010000:1.0:1782241100.882849:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000933adb91/0xc9959f2fb1e193a5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.882856:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000933adb91/0xc9959f2fb1e193a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.882863:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000933adb91/0xc9959f2fb1e193a5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.882869:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000933adb91/0xc9959f2fb1e193a5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241100.882881:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241100.883797:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9ba752e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+13:3639:x1868815139873280:12345-0@lo:103: Request processed in 1172us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.883806:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782241100.883874:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008f87edf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139873152:0@lo:103: 00080000:10000000:3.0:1782241100.884615:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1782241100.884806:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1782241100.885013:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1782241100.885182:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1782241100.885376:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1782241100.885529:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:2.0:1782241100.886088:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007ab81772 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139873280:0@lo:103: 00080000:10000000:3.0:1782241100.886942:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1782241100.887182:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1782241100.887467:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1782241100.887642:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1782241100.887866:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1782241100.888050:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1782241100.890276:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1782241100.890568:0:7464:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1782241100.890621:0:7464:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c65dc105 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7464:1868815139873408:0@lo:700: 00000100:00100000:3.0:1782241100.890693:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241100.890750:0:7464:0:(client.c:2701:ptlrpc_set_wait()) set 00000000145144c5 going to sleep for 11 seconds 00000040:01000000:0.0:1782241100.890860:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1782241100.891005:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139873408 00000100:00100000:2.0:1782241100.891014:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139873408 00000100:00100000:2.0:1782241100.891245:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241100.891253:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e1ba52c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7464:x1868815139873408:12345-0@lo:700: 00000020:00080000:1.0:1782241100.891735:0:7463:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1782241100.891740:0:7463:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:2.0:1782241100.892199:0:7465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d317c575 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1868815139873536:0@lo:1000: 00000100:00100000:2.0:1782241100.892264:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241100.892291:0:7465:0:(client.c:2701:ptlrpc_set_wait()) set 000000000eede663 going to sleep for 11 seconds 00000100:00100000:1.0:1782241100.892345:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139873536 00000100:00100000:1.0:1782241100.892351:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139873536 00000100:00100000:1.0:1782241100.892390:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782241100.892396:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005896fd17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1868815139873536:12345-0@lo:1000: 00000100:00100000:1.0:1782241100.892473:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005896fd17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1868815139873536:12345-0@lo:1000: Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.892481:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782241100.892615:0:7465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d317c575 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1868815139873536:0@lo:1000: 00000040:01000000:2.0:1782241100.892641:0:7465:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1782241100.892664:0:7465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d317c575 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1868815139873664:0@lo:700: 00000100:00100000:2.0:1782241100.892691:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241100.892713:0:7465:0:(client.c:2701:ptlrpc_set_wait()) set 000000000eede663 going to sleep for 11 seconds 00000100:00100000:1.0:1782241100.892828:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139873664 00000100:00100000:1.0:1782241100.892832:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139873664 00000100:00100000:1.0:1782241100.892858:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241100.892863:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088d12d5a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7465:x1868815139873664:12345-0@lo:700: 00000100:00100000:1.0:1782241100.892906:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088d12d5a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7465:x1868815139873664:12345-0@lo:700: Request processed in 42us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.892913:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241100.892975:0:7465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d317c575 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1868815139873664:0@lo:700: 00000100:00100000:2.0:1782241100.893008:0:7465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d317c575 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7465:1868815139873792:0@lo:900: 00000100:00100000:2.0:1782241100.893034:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241100.893099:0:7465:0:(client.c:2701:ptlrpc_set_wait()) set 000000000eede663 going to sleep for 11 seconds 00000040:01000000:0.0:1782241100.893581:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1782241100.893694:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1782241100.894201:0:7440:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1782241100.894209:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1782241100.894344:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:3.0:1782241100.896932:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:0.0:1782241100.900741:0:7440:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1782241100.901327:0:7440:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1782241100.901359:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00010000:00080000:2.0:1782241100.901984:0:7464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c65dc105 x1868815139873408/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782241116 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241100.902015:0:7464:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c65dc105 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7464:1868815139873408:0@lo:700: 40000000:02000000:2.0:1782241100.902028:0:7464:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:1.0:1782241100.905905:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139873792 00000100:00100000:1.0:1782241100.905921:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139873792 00000100:00100000:1.0:1782241100.905987:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241100.905996:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fba41ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7465:x1868815139873792:12345-0@lo:900: 00000040:00080000:0.0:1782241100.906301:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1782241100.906594:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1782241100.907246:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1782241100.907374:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1782241100.907502:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1782241100.907651:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1782241100.907826:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1782241100.907962:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1782241100.908191:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1782241100.908339:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1782241100.908479:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1782241100.908619:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1782241100.908813:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1782241100.908935:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1782241100.909088:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1782241100.909220:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1782241100.909359:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1782241100.909480:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00010000:00080000:2.0:1782241100.912918:0:7465:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d317c575 x1868815139873792/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782241116 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241100.912939:0:7465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d317c575 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7465:1868815139873792:0@lo:900: 00000100:00100000:2.0:1782241100.913043:0:7465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d317c575 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1868815139873920:0@lo:1000: 00000100:00100000:2.0:1782241100.913103:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241100.913143:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139873920 00000100:00100000:2.0:1782241100.913149:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139873920 00000100:00100000:2.0:1782241100.913192:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782241100.913200:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034f7be53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1868815139873920:12345-0@lo:1000: 00000100:00100000:1.0:1782241100.913361:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fba41ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7465:x1868815139873792:12345-0@lo:900: Request processed in 4722us (17680us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241100.913372:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241100.913464:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034f7be53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1868815139873920:12345-0@lo:1000: Request processed in 264us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241100.913472:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782241100.913510:0:7465:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ec9a6fbb going to sleep for 11 seconds 00000100:00100000:2.0:1782241100.913524:0:7465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d317c575 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1868815139873920:0@lo:1000: 00000004:00080000:2.0:1782241100.913578:0:7465:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000000eede663 with version 0 00000020:00100000:2.0:1782241100.913590:0:7465:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782241100.913594:0:7465:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d317c575 x1868815139874176/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782241100.913604:0:7465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d317c575 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1868815139874176:0@lo:1000: 00000100:00100000:2.0:1782241100.913628:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241100.914074:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e1ba52c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7464:x1868815139873408:12345-0@lo:700: Request processed in 22820us (23379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241100.914090:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241100.914366:0:7465:0:(client.c:2701:ptlrpc_set_wait()) set 00000000be4f6f80 going to sleep for 11 seconds 00100000:10000000:0.0:1782241100.916170:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1782241100.916400:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1782241100.916558:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1782241100.918008:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1782241100.918225:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00000100:00100000:1.0:1782241100.918687:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139874176 00000100:00100000:1.0:1782241100.918699:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139874176 00000100:00100000:1.0:1782241100.918775:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782241100.918783:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009010b5c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1868815139874176:12345-0@lo:1000: 00100000:10000000:0.0:1782241100.919233:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000040:00080000:3.0:1782241100.922211:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1782241100.923633:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1782241100.924859:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1782241100.925018:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1782241100.925170:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1782241100.925926:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1782241100.926076:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1782241100.926209:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00000001:00080000:1.0:1782241100.926902:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1782241100.927083:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009010b5c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1868815139874176:12345-0@lo:1000: Request processed in 8298us (13451us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1782241100.927096:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00100000:10000000:0.0:1782241100.927558:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1782241100.927713:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1782241100.928013:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000004:00080000:2.0:1782241100.928492:0:7465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1782241100.928503:0:7465:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1782241100.928520:0:7465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d317c575 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1868815139874176:0@lo:1000: 00000100:00100000:2.0:1782241100.928615:0:7465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d317c575 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1868815139874304:0@lo:1000: 00000100:00100000:2.0:1782241100.928661:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241100.928711:0:7465:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d4d0ea16 going to sleep for 11 seconds 00000001:00000004:0.0:1782241100.928917:0:7440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1782241100.929014:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139874304 00000100:00100000:3.0:1782241100.929020:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139874304 00000100:00100000:3.0:1782241100.929066:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782241100.929082:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7035675 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1868815139874304:12345-0@lo:1000: 00000100:00100000:3.0:1782241100.929182:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7035675 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1868815139874304:12345-0@lo:1000: Request processed in 101us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241100.929189:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782241100.929222:0:7465:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d317c575 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7465:1868815139874304:0@lo:1000: 00000040:00080000:3.0:1782241100.929239:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1782241100.929393:0:7465:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000f56288e0 with version 1 00000004:00080000:0.0:1782241100.930802:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000f739da69 version 1 rpc_version 1 00000020:00100000:0.0:1782241100.930839:0:7455:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782241100.930848:0:7455:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000506812ef x1868815139874560/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782241100.930868:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000506812ef pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1868815139874560:0@lo:1000: 00000100:00100000:0.0:1782241100.930937:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241100.930981:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set 0000000055c01688 going to sleep for 11 seconds 00000100:00100000:2.0:1782241100.931029:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139874560 00000100:00100000:2.0:1782241100.931036:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139874560 00000100:00100000:2.0:1782241100.931079:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782241100.931086:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f25ae23 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7455:x1868815139874560:12345-0@lo:1000: 00000040:00080000:3.0:1782241100.933031:0:7465:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1782241100.933113:0:7465:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:1.0:1782241100.935856:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1782241100.942388:0:7440:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1782241100.942431:0:7440:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa60ac1c73988 00100000:10000000:3.0:1782241100.942440:0:7440:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:0.0:1782241100.942843:0:7464:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1782241100.942908:0:7464:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1782241100.942912:0:7464:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:01000004:3.0:1782241100.943436:0:7440:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782241100.943462:0:7440:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.158@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782241100.943484:0:7440:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1782241100.943499:0:7440:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1782241100.944492:0:7440:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782241100.944678:0:7440:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1782241100.955090:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f25ae23 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7455:x1868815139874560:12345-0@lo:1000: Request processed in 23999us (24148us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1782241100.955107:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1782241100.968955:0:7455:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1782241100.968966:0:7455:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1782241100.968989:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000506812ef pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1868815139874560:0@lo:1000: 00010000:00010000:1.0:1782241101.444913:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241102.475050:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241103.494565:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241104.516944:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782241104.935008:0:7709:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782241105.540945:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782241105.670556:0:7761:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782241105.670930:0:7761:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1782241106.186504:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241106.186527:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008f87edf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139874688:0@lo:41: 00000100:00100000:1.0:1782241106.186596:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241106.186662:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139874688 00000100:00100000:1.0:1782241106.186670:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139874688 00000100:00100000:1.0:1782241106.186710:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782241106.186718:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb753b60 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139874688:12345-0@lo:41: 00000004:00000024:1.0:1782241106.186776:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1782241106.186822:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb753b60 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139874688:12345-0@lo:41: Request processed in 105us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241106.186830:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782241106.186869:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008f87edf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139874688:0@lo:41: 00000100:00100000:2.0:1782241106.187204:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fc4b5973 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139874816:0@lo:400: 00000100:00100000:2.0:1782241106.187235:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241106.187267:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241106.187271:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007f54516e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139874944:0@lo:400: 00000100:00100000:2.0:1782241106.187292:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241106.187309:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782241106.187314:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c65dc105 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815139875072:0@lo:400: 00000100:00100000:2.0:1782241106.187331:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241106.187357:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139874944 00000100:00100000:2.0:1782241106.187360:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139874944 00000100:00100000:2.0:1782241106.187381:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139875072 00000100:00100000:2.0:1782241106.187382:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139875072 00000100:00100000:2.0:1782241106.187393:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782241106.187399:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab63903d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139874944:12345-0@lo:400: 00000100:00100000:2.0:1782241106.187444:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab63903d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139874944:12345-0@lo:400: Request processed in 45us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241106.187452:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782241106.187474:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782241106.187478:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002056d4ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815139875072:12345-0@lo:400: 00000100:00100000:2.0:1782241106.187510:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002056d4ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815139875072:12345-0@lo:400: Request processed in 32us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241106.187515:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1782241106.187540:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007f54516e x1868815139874944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241106.187551:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007f54516e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139874944:0@lo:400: 00010000:00080000:2.0:1782241106.187577:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c65dc105 x1868815139875072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241106.187585:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c65dc105 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815139875072:0@lo:400: 00000100:00100000:3.0:1782241106.187685:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139874816 00000100:00100000:3.0:1782241106.187689:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139874816 00000100:00100000:3.0:1782241106.187718:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782241106.187723:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002343a0ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+13:3637:x1868815139874816:12345-0@lo:400: 00000100:00100000:3.0:1782241106.187786:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002343a0ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+13:3637:x1868815139874816:12345-0@lo:400: Request processed in 62us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241106.187792:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782241106.187835:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fc4b5973 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139874816:0@lo:400: 00010000:00010000:3.0:1782241106.569453:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241107.590514:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782241107.726409:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782241107.726417:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890e43609000 from 4 10000000:01000000:2.0:1782241107.726422:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782241107.726467:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 000000006210680a/0xc9959f2fb1e193ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241107.726480:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 000000006210680a/0xc9959f2fb1e193ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241107.726490:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 000000006210680a/0xc9959f2fb1e193ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241107.726512:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002cf443de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139875200:0@lo:101: 00000100:00100000:2.0:1782241107.726573:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241107.726622:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 00000000084accf2 going to sleep for 11 seconds 00000100:00100000:3.0:1782241107.727576:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139875200 00000100:00100000:3.0:1782241107.727585:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139875200 00000100:00100000:3.0:1782241107.727645:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782241107.727652:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000150c28bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+13:6508:x1868815139875200:12345-0@lo:101: 00010000:00010000:3.0:1782241107.727666:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241107.727680:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032f63605/0xc9959f2fb1e193b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e193ac expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.727702:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032f63605/0xc9959f2fb1e193b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e193ac expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.727712:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032f63605/0xc9959f2fb1e193b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e193ac expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.727720:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032f63605, rc 0) 00000100:00100000:3.0:1782241107.727788:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000150c28bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+14:6508:x1868815139875200:12345-0@lo:101: Request processed in 136us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241107.727797:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782241107.728129:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002cf443de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139875200:0@lo:101: 00010000:00010000:2.0:1782241107.728571:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 000000006210680a/0xc9959f2fb1e193ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e193b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241107.728581:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 000000006210680a/0xc9959f2fb1e193ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e193b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241107.728639:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002cf443de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139875328:0@lo:256: 00000100:00100000:2.0:1782241107.728679:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241107.728715:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 00000000084accf2 going to sleep for 11 seconds 00000100:00100000:3.0:1782241107.729245:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139875328 00000100:00100000:3.0:1782241107.729255:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139875328 00000100:00100000:3.0:1782241107.729293:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782241107.729300:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005969ecac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+14:6508:x1868815139875328:12345-0@lo:256: 20000000:01000000:3.0:1782241107.729317:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782241107.729333:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782241107.729335:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1782241107.732957:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005969ecac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+14:6508:x1868815139875328:12345-0@lo:256: Request processed in 3650us (4271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241107.732974:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782241107.733053:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002cf443de pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139875328:0@lo:256: 10000000:01000000:3.0:1782241107.733119:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782241107.733129:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 000000006210680a/0xc9959f2fb1e193ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e193b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.733139:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 000000006210680a/0xc9959f2fb1e193ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e193b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241107.733149:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782241107.733152:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e48138000 from 21 10000000:01000000:3.0:1782241107.733167:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782241107.733199:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 00000000724a6da4/0xc9959f2fb1e193ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.733206:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 00000000724a6da4/0xc9959f2fb1e193ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.733215:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 00000000724a6da4/0xc9959f2fb1e193ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241107.733232:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fc4b5973 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139875456:0@lo:101: 00000100:00100000:3.0:1782241107.733269:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241107.733306:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f2dd71a7 going to sleep for 11 seconds 00000100:00100000:2.0:1782241107.733442:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139875456 00000100:00100000:2.0:1782241107.733449:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139875456 00000100:00100000:2.0:1782241107.733493:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782241107.733501:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079a04e01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+14:6508:x1868815139875456:12345-0@lo:101: 00010000:00010000:2.0:1782241107.733513:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241107.733523:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c7d6b947/0xc9959f2fb1e193c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e193ba expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241107.733547:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c7d6b947/0xc9959f2fb1e193c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e193ba expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241107.733557:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c7d6b947/0xc9959f2fb1e193c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e193ba expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241107.733566:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c7d6b947, rc 0) 00000100:00100000:2.0:1782241107.733603:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079a04e01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:6508:x1868815139875456:12345-0@lo:101: Request processed in 102us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241107.733618:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782241107.733664:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fc4b5973 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139875456:0@lo:101: 00010000:00010000:3.0:1782241107.733681:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 00000000724a6da4/0xc9959f2fb1e193ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e193c1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.733690:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 00000000724a6da4/0xc9959f2fb1e193ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e193c1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241107.733896:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fc4b5973 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139875584:0@lo:501: 00000100:00100000:3.0:1782241107.733926:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241107.734085:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f2dd71a7 going to sleep for 11 seconds 00000100:00100000:2.0:1782241107.736733:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139875584 00000100:00100000:2.0:1782241107.736746:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139875584 00000100:00100000:2.0:1782241107.736813:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782241107.736821:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c4f1f38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:6508:x1868815139875584:12345-0@lo:501: 00000100:00100000:2.0:1782241107.736981:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c4f1f38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:6508:x1868815139875584:12345-0@lo:501: Request processed in 161us (3054us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241107.736989:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782241107.737775:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fc4b5973 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139875584:0@lo:501: 00000100:00100000:3.0:1782241107.737824:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fc4b5973 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139875712:0@lo:503: 00000100:00100000:3.0:1782241107.737871:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241107.737902:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f2dd71a7 going to sleep for 11 seconds 00000100:00100000:1.0:1782241107.738311:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139875712 00000100:00100000:1.0:1782241107.738318:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139875712 00000100:00100000:1.0:1782241107.738503:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782241107.738513:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030ad6f66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:6508:x1868815139875712:12345-0@lo:503: 00000100:00100000:1.0:1782241107.738643:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030ad6f66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:6508:x1868815139875712:12345-0@lo:503: Request processed in 131us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241107.738651:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782241107.738742:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fc4b5973 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139875712:0@lo:503: 00000100:00100000:3.0:1782241107.741290:0:7830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fc4b5973 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:7830:1868815139875840:0@lo:502: 00000100:00100000:3.0:1782241107.741433:0:7830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241107.741473:0:7830:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ce7018a6 going to sleep for 11 seconds 00000100:00100000:1.0:1782241107.741518:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139875840 00000100:00100000:1.0:1782241107.741525:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139875840 00000100:00100000:1.0:1782241107.741566:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782241107.741573:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ee9bf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:7830:x1868815139875840:12345-0@lo:502: 00000100:00100000:1.0:1782241107.741695:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ee9bf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:7830:x1868815139875840:12345-0@lo:502: Request processed in 122us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241107.741703:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782241107.744448:0:7830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fc4b5973 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:7830:1868815139875840:0@lo:502: 00000100:00100000:3.0:1782241107.744528:0:7830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fc4b5973 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:7830:1868815139875968:0@lo:502: 00000100:00100000:3.0:1782241107.744589:0:7830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241107.744629:0:7830:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ce7018a6 going to sleep for 11 seconds 00000100:00100000:1.0:1782241107.744814:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139875968 00000100:00100000:1.0:1782241107.744821:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139875968 00000100:00100000:1.0:1782241107.744875:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782241107.744883:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa5630f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:7830:x1868815139875968:12345-0@lo:502: 00000100:00100000:3.0:1782241107.747800:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa5630f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:7830:x1868815139875968:12345-0@lo:502: Request processed in 2910us (3204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241107.747812:0:7830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fc4b5973 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:7830:1868815139875968:0@lo:502: 00000100:00100000:3.0:1782241107.747814:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000040:00080000:2.0:1782241107.747847:0:7830:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1782241107.748129:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1782241107.748156:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782241107.748166:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 00000000724a6da4/0xc9959f2fb1e193ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e193c1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.748178:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 00000000724a6da4/0xc9959f2fb1e193ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e193c1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241107.748194:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782241107.748196:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890e48138000 from 4 10000000:01000000:3.0:1782241107.748199:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782241107.748230:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 000000009bafcfca/0xc9959f2fb1e193c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.748238:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 000000009bafcfca/0xc9959f2fb1e193c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.748245:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 000000009bafcfca/0xc9959f2fb1e193c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241107.748264:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006763e8b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139876096:0@lo:101: 00000100:00100000:3.0:1782241107.748297:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241107.748333:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 0000000060121d1f going to sleep for 11 seconds 00000100:00100000:2.0:1782241107.748382:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139876096 00000100:00100000:2.0:1782241107.748388:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139876096 00000100:00100000:2.0:1782241107.748437:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782241107.748446:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aad5a037 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:6508:x1868815139876096:12345-0@lo:101: 00010000:00010000:2.0:1782241107.748457:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241107.748467:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000949ffbd5/0xc9959f2fb1e193cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e193c8 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241107.748489:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000949ffbd5/0xc9959f2fb1e193cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e193c8 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241107.748499:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000949ffbd5/0xc9959f2fb1e193cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e193c8 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241107.748507:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000949ffbd5, rc 0) 00000100:00100000:2.0:1782241107.748535:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aad5a037 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139876096:12345-0@lo:101: Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241107.748550:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782241107.748976:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006763e8b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139876096:0@lo:101: 00010000:00010000:3.0:1782241107.748988:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 000000009bafcfca/0xc9959f2fb1e193c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e193cf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.748996:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 000000009bafcfca/0xc9959f2fb1e193c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e193cf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241107.749044:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006763e8b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139876224:0@lo:256: 00000100:00100000:3.0:1782241107.749080:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241107.749110:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 0000000060121d1f going to sleep for 11 seconds 00000100:00100000:3.0:1782241107.749125:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139876224 00000100:00100000:3.0:1782241107.749128:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139876224 00000100:00100000:3.0:1782241107.749163:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782241107.749175:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001727ecc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139876224:12345-0@lo:256: 20000000:01000000:3.0:1782241107.749189:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782241107.749203:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782241107.749206:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1782241107.749273:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001727ecc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139876224:12345-0@lo:256: Request processed in 98us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241107.749280:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782241107.749312:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006763e8b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139876224:0@lo:256: 10000000:01000000:3.0:1782241107.749359:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782241107.749364:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 000000009bafcfca/0xc9959f2fb1e193c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e193cf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.749371:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 000000009bafcfca/0xc9959f2fb1e193c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e193cf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241107.749379:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782241107.749381:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1782241107.749383:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782241107.749427:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 000000003d3be033/0xc9959f2fb1e193d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.749434:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 000000003d3be033/0xc9959f2fb1e193d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.749443:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 000000003d3be033/0xc9959f2fb1e193d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241107.749455:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006763e8b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139876352:0@lo:101: 00000100:00100000:3.0:1782241107.749479:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241107.749499:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 0000000060121d1f going to sleep for 11 seconds 00000100:00100000:3.0:1782241107.749512:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139876352 00000100:00100000:3.0:1782241107.749516:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139876352 00000100:00100000:3.0:1782241107.749537:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782241107.749543:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e71b93ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139876352:12345-0@lo:101: 00010000:00010000:3.0:1782241107.749550:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241107.749557:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000051fb7fc0/0xc9959f2fb1e193dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e193d6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.749571:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051fb7fc0/0xc9959f2fb1e193dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e193d6 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.749579:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000051fb7fc0/0xc9959f2fb1e193dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e193d6 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241107.749586:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000051fb7fc0, rc 0) 00000100:00100000:3.0:1782241107.749620:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e71b93ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139876352:12345-0@lo:101: Request processed in 78us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241107.749626:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782241107.749867:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006763e8b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139876352:0@lo:101: 00010000:00010000:0.0:1782241107.749879:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 000000003d3be033/0xc9959f2fb1e193d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e193dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241107.749887:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 000000003d3be033/0xc9959f2fb1e193d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e193dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241107.750100:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000068bff70e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139876480:0@lo:501: 00000100:00100000:0.0:1782241107.750288:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241107.750308:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 0000000042c336f2 going to sleep for 11 seconds 00000100:00100000:3.0:1782241107.750734:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139876480 00000100:00100000:3.0:1782241107.750740:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139876480 00000100:00100000:3.0:1782241107.750802:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782241107.750810:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056c1fe75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139876480:12345-0@lo:501: 00000100:00100000:3.0:1782241107.750933:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056c1fe75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139876480:12345-0@lo:501: Request processed in 124us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241107.750940:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782241107.751674:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000068bff70e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139876480:0@lo:501: 00000100:00100000:0.0:1782241107.751714:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000068bff70e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139876608:0@lo:503: 00000100:00100000:0.0:1782241107.751903:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241107.751934:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 0000000042c336f2 going to sleep for 11 seconds 00000100:00100000:3.0:1782241107.751971:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139876608 00000100:00100000:3.0:1782241107.751976:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139876608 00000100:00100000:3.0:1782241107.752012:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782241107.752018:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079deac8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139876608:12345-0@lo:503: 00000100:00100000:3.0:1782241107.752115:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079deac8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139876608:12345-0@lo:503: Request processed in 97us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241107.752122:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782241107.752213:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000068bff70e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139876608:0@lo:503: 00000100:00100000:0.0:1782241107.754010:0:7832:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000068bff70e pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:7832:1868815139876736:0@lo:502: 00000100:00100000:0.0:1782241107.754073:0:7832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241107.754113:0:7832:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ecfbbd64 going to sleep for 11 seconds 00000100:00100000:3.0:1782241107.754157:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139876736 00000100:00100000:3.0:1782241107.754163:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139876736 00000100:00100000:3.0:1782241107.754207:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782241107.754214:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8ed49a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:7832:x1868815139876736:12345-0@lo:502: 00000100:00100000:3.0:1782241107.754318:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8ed49a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:7832:x1868815139876736:12345-0@lo:502: Request processed in 105us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241107.754326:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782241107.754411:0:7832:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000068bff70e pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:7832:1868815139876736:0@lo:502: 00000020:01000000:1.0:1782241107.754438:0:7832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241107.754450:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241107.754452:0:7832:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1782241107.754457:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782241107.754460:0:7832:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:00000080:1.0:1782241107.754482:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782241107.754497:0:7832:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000e264408d) 00000020:00000080:1.0:1782241107.754517:0:7832:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1782241107.754525:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782241107.754613:0:7832:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1782241107.754620:0:7832:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1782241107.754627:0:7832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e193eb 00010000:00080000:1.0:1782241107.754667:0:7832:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000906d8763@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241107.756327:0:7832:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1782241107.759899:0:7832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782241107.759915:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1782241107.759960:0:7832:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1782241107.759984:0:7832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e193f2 00000100:00080000:0.0:1782241107.759996:0:7832:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782241107.760002:0:7832:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000906d8763 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241107.760036:0:7832:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007ed931e4 x1868815139876864/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241107.760060:0:7832:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1782241107.760099:0:7832:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1782241107.760259:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007ed931e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815139876864:0@lo:38: 00000100:00100000:3.0:1782241107.760328:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241107.760464:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139876864 00000100:00100000:0.0:1782241107.760471:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139876864 00000100:00100000:0.0:1782241107.760508:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782241107.760514:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a8639f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1868815139876864:12345-0@lo:38: 00010000:00080000:0.0:1782241107.760538:0:6516:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:0.0:1782241107.760567:0:6516:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e193f9 00000004:00100000:0.0:1782241107.760579:0:6516:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1782241107.760584:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1782241107.760719:0:7835:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000007da02d1b x1868815139876992/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241107.760728:0:7835:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a4fe1fff going to sleep for 0 seconds 00000020:01000000:0.0:1782241107.760789:0:7832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241107.760794:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241107.760795:0:7832:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1782241107.760803:0:7832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782241107.760807:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241107.760808:0:7832:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782241107.760811:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782241107.760812:0:7832:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782241107.760830:0:7832:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007860a329 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:7832:1868815139877120:0@lo:502: 00000100:00100000:0.0:1782241107.760872:0:7832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241107.760885:0:7832:0:(client.c:2701:ptlrpc_set_wait()) set 0000000036cd15e0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241107.761077:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e6a26d6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139877376:0@lo:400: 00000100:00100000:1.0:1782241107.761105:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241107.761126:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782241107.761131:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000030b71e38 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815139877504:0@lo:400: 00000100:00100000:1.0:1782241107.761157:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241107.761189:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1782241107.761196:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1782241107.761291:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139877120 00000100:00100000:1.0:1782241107.761296:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139877120 00000100:00100000:1.0:1782241107.761327:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782241107.761334:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afebafca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+17:7832:x1868815139877120:12345-0@lo:502: 00000100:00100000:1.0:1782241107.761452:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afebafca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+17:7832:x1868815139877120:12345-0@lo:502: Request processed in 118us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241107.761469:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782241107.761520:0:7832:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007860a329 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:7832:1868815139877120:0@lo:502: 00000020:01000000:1.0:1782241107.761544:0:7832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241107.761549:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241107.761551:0:7832:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782241107.761555:0:7832:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1782241107.761602:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1782241107.761630:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782241107.761638:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 000000003d3be033/0xc9959f2fb1e193d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e193dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241107.761647:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 000000003d3be033/0xc9959f2fb1e193d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e193dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241107.761656:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1782241107.761658:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff890e43633380 from 1 10000000:01000000:1.0:1782241107.761661:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782241107.761682:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 00000000173a7cc9/0xc9959f2fb1e19400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241107.761689:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 00000000173a7cc9/0xc9959f2fb1e19400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241107.761698:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 00000000173a7cc9/0xc9959f2fb1e19400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241107.761708:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e60fd225 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139877632:0@lo:101: 00000100:00100000:1.0:1782241107.761733:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241107.761783:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 00000000230be8e8 going to sleep for 11 seconds 00000100:00100000:1.0:1782241107.761803:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139877632 00000100:00100000:1.0:1782241107.761807:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139877632 00000100:00100000:1.0:1782241107.761830:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782241107.761835:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000212bfce7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139877632:12345-0@lo:101: 00010000:00010000:1.0:1782241107.761843:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241107.761854:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000062623338/0xc9959f2fb1e19407 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19400 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241107.761872:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000062623338/0xc9959f2fb1e19407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19400 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241107.761881:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000062623338/0xc9959f2fb1e19407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19400 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241107.761889:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000062623338, rc 0) 00000100:00100000:1.0:1782241107.761915:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000212bfce7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139877632:12345-0@lo:101: Request processed in 80us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241107.761921:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782241107.761947:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e60fd225 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139877632:0@lo:101: 00010000:00010000:1.0:1782241107.761957:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 00000000173a7cc9/0xc9959f2fb1e19400 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241107.761965:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 00000000173a7cc9/0xc9959f2fb1e19400 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241107.762003:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e60fd225 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139877760:0@lo:501: 00000100:00100000:1.0:1782241107.762027:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241107.762043:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 00000000230be8e8 going to sleep for 11 seconds 00000100:00100000:1.0:1782241107.762054:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139877760 00000100:00100000:1.0:1782241107.762064:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139877760 00000100:00100000:1.0:1782241107.762087:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782241107.762093:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6ce07f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139877760:12345-0@lo:501: 00000100:00100000:1.0:1782241107.762153:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6ce07f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139877760:12345-0@lo:501: Request processed in 60us (125us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782241107.762159:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782241107.762186:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e60fd225 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139877760:0@lo:501: 10000000:01000000:1.0:1782241107.762205:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782241107.762209:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: 00000000173a7cc9/0xc9959f2fb1e19400 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241107.762216:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: 00000000173a7cc9/0xc9959f2fb1e19400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241107.762343:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008f87edf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139877248:0@lo:400: 00000100:00100000:3.0:1782241107.762371:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241107.762517:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139877376 00000100:00100000:3.0:1782241107.762520:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139877376 00000100:00100000:0.0:1782241107.762631:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782241107.762638:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000821a0a2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139877376:12345-0@lo:400: 00000100:00100000:0.0:1782241107.762695:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000821a0a2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139877376:12345-0@lo:400: Request processed in 58us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241107.762702:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782241107.762784:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e6a26d6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139877376:0@lo:400: 00000100:00100000:0.0:1782241107.762854:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139877504 00000100:00100000:0.0:1782241107.762859:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139877504 00000100:00100000:0.0:1782241107.762892:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139877248 00000100:00100000:0.0:1782241107.762895:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139877248 00000100:00100000:0.0:1782241107.762911:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782241107.762917:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006352349c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815139877504:12345-0@lo:400: 00000100:00100000:0.0:1782241107.762952:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006352349c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815139877504:12345-0@lo:400: Request processed in 36us (1795us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241107.762958:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782241107.762971:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782241107.762976:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092a8aba0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139877248:12345-0@lo:400: 00000100:00100000:0.0:1782241107.763006:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092a8aba0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139877248:12345-0@lo:400: Request processed in 30us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241107.763012:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1782241107.763036:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000030b71e38 x1868815139877504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241107.763052:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000030b71e38 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815139877504:0@lo:400: 00010000:00080000:0.0:1782241107.763080:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008f87edf3 x1868815139877248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241107.763089:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008f87edf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139877248:0@lo:400: 00000100:00080000:2.0:1782241107.773574:0:6516:0:(import.c:65:import_set_state_nolock()) 00000000b40a337f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241107.773674:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a8639f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1868815139876864:12345-0@lo:38: Request processed in 13159us (13346us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241107.773685:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782241107.774187:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782241107.774207:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1782241107.774215:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1782241107.774221:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1782241107.774223:0:3636:0:(import.c:65:import_set_state_nolock()) 00000000906d8763 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1782241107.774243:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a4fe1fff): req@000000007da02d1b x1868815139876992/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241107.774260:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007ed931e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815139876864:0@lo:38: 00000100:00100000:1.0:1782241107.774327:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782241107.774339:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e60fd225 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139877888:0@lo:41: 00000100:00100000:1.0:1782241107.774382:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241107.774444:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139877888 00000100:00100000:1.0:1782241107.774450:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139877888 00000100:00100000:1.0:1782241107.774482:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782241107.774489:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000303057c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1868815139877888:12345-0@lo:41: 00000004:00000024:1.0:1782241107.774513:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1782241107.774547:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000303057c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1868815139877888:12345-0@lo:41: Request processed in 58us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241107.774552:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782241107.774582:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e60fd225 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139877888:0@lo:41: 00000100:00100000:0.0:1782241107.774863:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241107.774882:0:7835:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a4fe1fff going to sleep for 11 seconds 00000100:00100000:0.0:1782241107.774896:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139876992 00000100:00100000:0.0:1782241107.774899:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139876992 00000100:00100000:0.0:1782241107.774920:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782241107.774925:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebf531ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7835:x1868815139876992:12345-0@lo:1000: 00000100:00100000:0.0:1782241107.774982:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebf531ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7835:x1868815139876992:12345-0@lo:1000: Request processed in 57us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241107.774988:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782241107.775012:0:7835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007da02d1b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1868815139876992:0@lo:1000: 00000040:01000000:0.0:1782241107.775040:0:7835:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1782241107.775068:0:7835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007da02d1b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1868815139878016:0@lo:1000: 00000100:00100000:0.0:1782241107.775094:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241107.775107:0:7835:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a4fe1fff going to sleep for 11 seconds 00000100:00100000:0.0:1782241107.775116:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139878016 00000100:00100000:0.0:1782241107.775118:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139878016 00000100:00100000:0.0:1782241107.775133:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782241107.775138:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f84ac6b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7835:x1868815139878016:12345-0@lo:1000: 00000100:00100000:0.0:1782241107.775227:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f84ac6b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7835:x1868815139878016:12345-0@lo:1000: Request processed in 88us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241107.775233:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782241107.775267:0:7835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007da02d1b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1868815139878016:0@lo:1000: 00000100:00100000:0.0:1782241107.775301:0:7835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007da02d1b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1868815139878144:0@lo:700: 00000100:00100000:0.0:1782241107.775324:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241107.775336:0:7835:0:(client.c:2701:ptlrpc_set_wait()) set 000000003470498f going to sleep for 11 seconds 00000100:00100000:3.0:1782241107.775655:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139878144 00000100:00100000:3.0:1782241107.775665:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139878144 00000100:00100000:3.0:1782241107.775700:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782241107.775706:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea932b4c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7835:x1868815139878144:12345-0@lo:700: 00000100:00100000:3.0:1782241107.775748:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea932b4c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7835:x1868815139878144:12345-0@lo:700: Request processed in 43us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241107.775775:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782241107.775864:0:7835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007da02d1b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1868815139878144:0@lo:700: 00000100:00100000:0.0:1782241107.775949:0:7835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007da02d1b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1868815139878272:0@lo:1000: 00000100:00100000:0.0:1782241107.775974:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241107.775988:0:7835:0:(client.c:2701:ptlrpc_set_wait()) set 000000001b386d16 going to sleep for 11 seconds 00000100:00100000:0.0:1782241107.776055:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139878272 00000100:00100000:0.0:1782241107.776059:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139878272 00000100:00100000:0.0:1782241107.776079:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782241107.776084:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b19c6ec7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7835:x1868815139878272:12345-0@lo:1000: 00000100:00100000:0.0:1782241107.776127:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b19c6ec7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7835:x1868815139878272:12345-0@lo:1000: Request processed in 43us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241107.776134:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782241107.776155:0:7835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007da02d1b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1868815139878272:0@lo:1000: 00000004:00080000:0.0:1782241107.776191:0:7835:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000003470498f with version 0 00000020:00100000:0.0:1782241107.776203:0:7835:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782241107.776209:0:7835:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000007da02d1b x1868815139878528/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782241107.776221:0:7835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007da02d1b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1868815139878528:0@lo:1000: 00000100:00100000:0.0:1782241107.776242:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241107.776255:0:7835:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c96b6203 going to sleep for 11 seconds 00000100:00100000:3.0:1782241107.776647:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139878528 00000100:00100000:3.0:1782241107.776652:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139878528 00000100:00100000:3.0:1782241107.776682:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782241107.776689:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c61d2505 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7835:x1868815139878528:12345-0@lo:1000: 00000001:00080000:1.0:1782241107.785020:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1782241107.785039:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1782241107.785195:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c61d2505 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7835:x1868815139878528:12345-0@lo:1000: Request processed in 8502us (8948us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1782241107.785207:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1782241107.785294:0:7835:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1782241107.785298:0:7835:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1782241107.785313:0:7835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007da02d1b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1868815139878528:0@lo:1000: 00000100:00100000:1.0:1782241107.785397:0:7835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e60fd225 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1868815139878656:0@lo:1000: 00000100:00100000:1.0:1782241107.785446:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241107.785474:0:7835:0:(client.c:2701:ptlrpc_set_wait()) set 000000001a30ce0a going to sleep for 11 seconds 00000100:00100000:3.0:1782241107.785528:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139878656 00000100:00100000:3.0:1782241107.785535:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139878656 00000100:00100000:3.0:1782241107.785578:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782241107.785594:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5fd396a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7835:x1868815139878656:12345-0@lo:1000: 00000100:00100000:3.0:1782241107.785659:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5fd396a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7835:x1868815139878656:12345-0@lo:1000: Request processed in 66us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241107.785665:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782241107.785733:0:7835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e60fd225 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1868815139878656:0@lo:1000: 00000040:00080000:2.0:1782241107.785750:0:7835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1782241107.785804:0:7835:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000b158e0b5 with version 1 00000040:00080000:2.0:1782241107.788106:0:7835:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1782241107.788191:0:7835:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1782241107.788196:0:7835:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:3.0:1782241107.788563:0:7833:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000fe0a9dca version 1 rpc_version 1 00000020:00100000:3.0:1782241107.788609:0:7833:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1782241107.788618:0:7833:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000007afa6f4b x1868815139878912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782241107.788639:0:7833:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007afa6f4b pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7833:1868815139878912:0@lo:1000: 00000100:00100000:3.0:1782241107.788694:0:7833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241107.788735:0:7833:0:(client.c:2701:ptlrpc_set_wait()) set 0000000031d18de9 going to sleep for 11 seconds 00000100:00100000:1.0:1782241107.788897:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139878912 00000100:00100000:1.0:1782241107.788904:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139878912 00000100:00100000:1.0:1782241107.788941:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782241107.788949:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbe91164 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7833:x1868815139878912:12345-0@lo:1000: 00000001:00080000:1.0:1782241107.795088:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1782241107.795228:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbe91164 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7833:x1868815139878912:12345-0@lo:1000: Request processed in 6276us (6531us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1782241107.795241:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:3.0:1782241107.795316:0:7833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1782241107.795321:0:7833:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1782241107.795337:0:7833:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007afa6f4b pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7833:1868815139878912:0@lo:1000: 00000020:00000004:1.0:1782241108.354410:0:7869:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782241108.354612:0:7869:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782241108.613070:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241109.638250:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782241109.654027:0:7917:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd57ee08b0 20000000:00000080:3.0:1782241109.654046:0:7917:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff890e7d731000 uarg=0000000000000000 20000000:01000000:3.0:1782241109.654192:0:7917:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1782241109.654201:0:7917:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1782241109.654206:0:7917:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1782241109.654288:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1782241109.654302:0:7917:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1782241109.660188:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782241109.660690:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782241109.660974:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1782241109.661003:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1782241109.661035:0:7917:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782241109.661078:0:7917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008f6a64e6/0xc9959f2fb1e1940e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241109.661097:0:7917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000365472a2/0xc9959f2fb1e1928d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19286 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241109.661105:0:7917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b4c8ef29/0xc9959f2fb1e1937b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19374 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241109.661111:0:7917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008f6a64e6/0xc9959f2fb1e1940e lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241109.661148:0:7917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b4c8ef29/0xc9959f2fb1e1937b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19374 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241109.661174:0:7917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b4c8ef29/0xc9959f2fb1e1937b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19374 expref: 17 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241109.661202:0:7917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007afa6f4b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1868815139879040:0@lo:104: 00000100:00100000:3.0:1782241109.661283:0:7917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782241109.661377:0:7917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000365472a2/0xc9959f2fb1e1928d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19286 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241109.661385:0:7917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000365472a2/0xc9959f2fb1e1928d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19286 expref: 17 pid: 6504 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241109.661394:0:7917:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a7e01f97 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1868815139879168:0@lo:104: 00000100:00100000:3.0:1782241109.661414:0:7917:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f9592ff0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241109.661739:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782241109.661784:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241109.661825:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139879040 00000100:00100000:0.0:1782241109.661841:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139879040 00000100:00100000:0.0:1782241109.661896:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139879168 00000100:00100000:0.0:1782241109.661900:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139879168 00000100:00100000:0.0:1782241109.661917:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782241109.661937:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043974246 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+4:7917:x1868815139879040:12345-0@lo:104: 00010000:00010000:0.0:1782241109.661951:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e19374 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1937b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241109.662014:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782241109.662020:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043974246 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+4:7917:x1868815139879040:12345-0@lo:104: Request processed in 96us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241109.662027:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782241109.662078:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241109.662084:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000494c2fff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+3:7917:x1868815139879168:12345-0@lo:104: 00010000:00010000:0.0:1782241109.662090:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: 00000000bc374b6c/0xc9959f2fb1e19286 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1928d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241109.662125:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782241109.662130:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000494c2fff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+3:7917:x1868815139879168:12345-0@lo:104: Request processed in 47us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241109.662136:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1782241109.662152:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782241109.662156:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e19374 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1937b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241109.662164:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001343e1eb already unused, calling callback (000000002488b196) 10000000:00010000:0.0:1782241109.662167:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e19374 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1937b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241109.662184:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e19374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1937b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241109.662190:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e19374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1937b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241109.662196:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782241109.662233:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e19374 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1937b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241109.662240:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782241109.662255:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e19374 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1937b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241109.662261:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: 000000001343e1eb/0xc9959f2fb1e19374 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1937b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241109.662274:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241109.662276:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: 00000000bc374b6c/0xc9959f2fb1e19286 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1928d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241109.662282:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bc374b6c already unused, calling callback (000000002488b196) 10000000:00010000:0.0:1782241109.662284:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: 00000000bc374b6c/0xc9959f2fb1e19286 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1928d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241109.662289:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: 00000000bc374b6c/0xc9959f2fb1e19286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1928d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241109.662295:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: 00000000bc374b6c/0xc9959f2fb1e19286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1928d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241109.662304:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782241109.662316:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: 00000000bc374b6c/0xc9959f2fb1e19286 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1928d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241109.662321:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782241109.662496:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: 00000000bc374b6c/0xc9959f2fb1e19286 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1928d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241109.662503:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: 00000000bc374b6c/0xc9959f2fb1e19286 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1928d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241109.662517:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241109.662519:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241109.662520:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241109.662529:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241109.662540:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000557cba7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139879296:0@lo:103: 00000100:00100000:1.0:1782241109.662682:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782241109.662691:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007da02d1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139879424:0@lo:103: 00000100:00100000:1.0:1782241109.662730:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241109.662793:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139879424 00000100:00100000:1.0:1782241109.662798:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139879424 00010000:00010000:1.0:1782241109.662816:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000365472a2/0xc9959f2fb1e1928d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19286 expref: 18 pid: 6504 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241109.662839:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782241109.662845:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6b1acf5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62797b42-772f-434f-be35-dfdfcff291e0+18:3638:x1868815139879424:12345-0@lo:103: 00010000:00010000:1.0:1782241109.662856:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241109.662859:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000365472a2/0xc9959f2fb1e1928d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19286 expref: 18 pid: 6504 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241109.662878:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000365472a2/0xc9959f2fb1e1928d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19286 expref: 18 pid: 6504 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241109.662896:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241109.662935:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6b1acf5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62797b42-772f-434f-be35-dfdfcff291e0+18:3638:x1868815139879424:12345-0@lo:103: Request processed in 79us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241109.662942:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782241109.662979:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007da02d1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139879424:0@lo:103: 00000100:00100000:0.0:1782241109.663184:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241109.663290:0:7917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007afa6f4b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1868815139879040:0@lo:104: 00010000:00010000:3.0:1782241109.663300:0:7917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000365472a2/0xc9959f2fb1e1928d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19286 expref: 17 pid: 6504 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241109.663310:0:7917:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a7e01f97 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1868815139879168:0@lo:104: 00010000:00010000:3.0:1782241109.663326:0:7917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008f6a64e6/0xc9959f2fb1e1940e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241109.663443:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139879296 00000100:00100000:1.0:1782241109.663448:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139879296 00010000:00010000:1.0:1782241109.663463:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b4c8ef29/0xc9959f2fb1e1937b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19374 expref: 17 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241109.663492:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782241109.663497:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ed931e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+17:3639:x1868815139879296:12345-0@lo:103: 00010000:00010000:1.0:1782241109.663505:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241109.663508:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b4c8ef29/0xc9959f2fb1e1937b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19374 expref: 17 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241109.663517:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b4c8ef29/0xc9959f2fb1e1937b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19374 expref: 17 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241109.663527:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b4c8ef29/0xc9959f2fb1e1937b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19374 expref: 17 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241109.663539:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008f6a64e6/0xc9959f2fb1e1940e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241109.663676:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f6a64e6/0xc9959f2fb1e1940e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241109.663697:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008f6a64e6/0xc9959f2fb1e1940e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241109.663703:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008f6a64e6/0xc9959f2fb1e1940e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241109.663710:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008f6a64e6/0xc9959f2fb1e1940e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241109.663716:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008f6a64e6/0xc9959f2fb1e1940e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241109.663722:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008f6a64e6 already unused, calling callback (00000000a921267b) 00010000:00010000:1.0:1782241109.663725:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008f6a64e6/0xc9959f2fb1e1940e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241109.663732:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008f6a64e6/0xc9959f2fb1e1940e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241109.663743:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008f6a64e6/0xc9959f2fb1e1940e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241109.663751:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241109.663805:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ed931e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+16:3639:x1868815139879296:12345-0@lo:103: Request processed in 308us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241109.663812:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782241109.663836:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000557cba7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139879296:0@lo:103: 00010000:00010000:3.0:1782241109.664180:0:7917:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008f6a64e6/0xc9959f2fb1e1940e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241109.664188:0:7917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008f6a64e6/0xc9959f2fb1e1940e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241109.664193:0:7917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008f6a64e6/0xc9959f2fb1e1940e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241109.665718:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241110.661440:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241111.306198:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004f72a5c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139879552:0@lo:41: 00000100:00100000:3.0:1782241111.306319:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241111.307685:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139879552 00000100:00100000:0.0:1782241111.307695:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139879552 00000100:00100000:0.0:1782241111.307783:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782241111.307792:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7e01f97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139879552:12345-0@lo:41: 00000004:00000024:0.0:1782241111.307828:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1782241111.312493:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7e01f97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139879552:12345-0@lo:41: Request processed in 4693us (6165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241111.312509:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782241111.313892:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004f72a5c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139879552:0@lo:41: 00010000:00010000:3.0:1782241111.687295:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241112.709903:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241112.841197:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007afa6f4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139879680:0@lo:41: 00000100:00100000:3.0:1782241112.841282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241112.841408:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000042127a50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139879936:0@lo:400: 00000100:00100000:3.0:1782241112.841437:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241112.841463:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241112.841468:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ef60c792 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139880064:0@lo:400: 00000100:00100000:3.0:1782241112.841492:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241112.841525:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139879680 00000100:00100000:3.0:1782241112.841532:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139879680 00000100:00100000:3.0:1782241112.841573:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139880064 00000100:00100000:3.0:1782241112.841577:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139880064 00000100:00100000:3.0:1782241112.841594:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782241112.841600:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e0cb91a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139879680:12345-0@lo:41: 00000004:00000024:3.0:1782241112.841641:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1782241112.841683:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e0cb91a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139879680:12345-0@lo:41: Request processed in 82us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241112.841689:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782241112.841717:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782241112.841722:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006763e8b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139880064:12345-0@lo:400: 00000100:00100000:3.0:1782241112.841752:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006763e8b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139880064:12345-0@lo:400: Request processed in 31us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241112.841781:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782241112.841803:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000053dbdeb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139879808:0@lo:400: 00000100:00100000:3.0:1782241112.841834:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241112.841857:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241112.841862:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000097f0fca6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815139880192:0@lo:400: 00000100:00100000:3.0:1782241112.841884:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241112.841911:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139879808 00000100:00100000:3.0:1782241112.841914:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139879808 00000100:00100000:3.0:1782241112.841942:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782241112.841948:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e86db26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+16:3640:x1868815139879808:12345-0@lo:400: 00000100:00100000:3.0:1782241112.841982:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e86db26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+16:3640:x1868815139879808:12345-0@lo:400: Request processed in 35us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241112.841988:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782241112.842013:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139879936 00000100:00100000:3.0:1782241112.842016:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139879936 00000100:00100000:3.0:1782241112.842036:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139880192 00000100:00100000:3.0:1782241112.842039:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139880192 00000100:00100000:3.0:1782241112.842049:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782241112.842054:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f591e17 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139879936:12345-0@lo:400: 00000100:00100000:3.0:1782241112.842080:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f591e17 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139879936:12345-0@lo:400: Request processed in 27us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241112.842086:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782241112.842094:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782241112.842099:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc4b5973 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815139880192:12345-0@lo:400: 00000100:00100000:3.0:1782241112.842118:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc4b5973 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815139880192:12345-0@lo:400: Request processed in 19us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241112.842122:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1782241112.842156:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000097f0fca6 x1868815139880192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241112.842175:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000097f0fca6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815139880192:0@lo:400: 00000100:00100000:3.0:1782241112.842184:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000053dbdeb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139879808:0@lo:400: 00000100:00100000:3.0:1782241112.842207:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ef60c792 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139880064:0@lo:400: 00010000:00080000:3.0:1782241112.842214:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000042127a50 x1868815139879936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241112.842220:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000042127a50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139879936:0@lo:400: 00000100:00100000:3.0:1782241112.842243:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007afa6f4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139879680:0@lo:41: 00010000:00010000:3.0:1782241113.734029:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782241114.376488:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782241114.376496:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e43609000 from 1 10000000:01000000:1.0:1782241114.376502:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782241114.376552:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: 0000000052bbc522/0xc9959f2fb1e19415 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241114.376565:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: 0000000052bbc522/0xc9959f2fb1e19415 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241114.376575:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: 0000000052bbc522/0xc9959f2fb1e19415 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241114.376599:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c24e9c47 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139880320:0@lo:101: 00000100:00100000:1.0:1782241114.376667:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241114.376723:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ddad9a61 going to sleep for 11 seconds 00000100:00100000:1.0:1782241114.376747:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139880320 00000100:00100000:1.0:1782241114.376752:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139880320 00000100:00100000:1.0:1782241114.376812:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782241114.376819:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b73dce1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139880320:12345-0@lo:101: 00010000:00010000:1.0:1782241114.376832:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241114.376845:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000086711b8d/0xc9959f2fb1e1941c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19415 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241114.376865:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000086711b8d/0xc9959f2fb1e1941c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19415 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241114.376874:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000086711b8d/0xc9959f2fb1e1941c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19415 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241114.376883:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000086711b8d, rc 0) 00000100:00100000:1.0:1782241114.376919:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b73dce1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139880320:12345-0@lo:101: Request processed in 101us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241114.376926:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782241114.376976:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c24e9c47 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139880320:0@lo:101: 00010000:00010000:1.0:1782241114.376989:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: 0000000052bbc522/0xc9959f2fb1e19415 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1941c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241114.376996:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: 0000000052bbc522/0xc9959f2fb1e19415 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1941c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241114.377055:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c24e9c47 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139880448:0@lo:501: 00000100:00100000:1.0:1782241114.377080:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241114.377092:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ddad9a61 going to sleep for 11 seconds 00000100:00100000:3.0:1782241114.377217:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139880448 00000100:00100000:3.0:1782241114.377222:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139880448 00000100:00100000:3.0:1782241114.377254:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782241114.377260:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f344cc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139880448:12345-0@lo:501: 00000100:00100000:3.0:1782241114.377371:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f344cc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139880448:12345-0@lo:501: Request processed in 111us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241114.377377:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782241114.377468:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c24e9c47 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139880448:0@lo:501: 00000100:00100000:1.0:1782241114.377497:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c24e9c47 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139880576:0@lo:503: 00000100:00100000:1.0:1782241114.377534:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241114.377560:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ddad9a61 going to sleep for 11 seconds 00000100:00100000:3.0:1782241114.377609:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139880576 00000100:00100000:3.0:1782241114.377613:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139880576 00000100:00100000:3.0:1782241114.377641:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782241114.377648:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f0114ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139880576:12345-0@lo:503: 00000100:00100000:3.0:1782241114.377848:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f0114ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139880576:12345-0@lo:503: Request processed in 200us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241114.377854:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782241114.377942:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c24e9c47 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139880576:0@lo:503: 00000100:00100000:1.0:1782241114.378305:0:8168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c24e9c47 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8168:1868815139880704:0@lo:502: 00000100:00100000:1.0:1782241114.378338:0:8168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241114.378367:0:8168:0:(client.c:2701:ptlrpc_set_wait()) set 00000000df5b5cc3 going to sleep for 11 seconds 00000100:00100000:3.0:1782241114.378419:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139880704 00000100:00100000:3.0:1782241114.378430:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139880704 00000100:00100000:3.0:1782241114.378461:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782241114.378466:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003efb2fdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+17:8168:x1868815139880704:12345-0@lo:502: 00000100:00100000:3.0:1782241114.378540:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003efb2fdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+17:8168:x1868815139880704:12345-0@lo:502: Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241114.378547:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782241114.378584:0:8168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c24e9c47 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8168:1868815139880704:0@lo:502: 00000020:01000000:3.0:1782241114.378604:0:8168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241114.378613:0:8168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241114.378615:0:8168:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782241114.378622:0:8168:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890e43609000 00000020:00000080:3.0:1782241114.378624:0:8168:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782241114.378664:0:8168:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c6e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8168:1868815139880832:0@lo:502: 00000100:00100000:3.0:1782241114.378874:0:8168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241114.378931:0:8168:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e437486c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241114.379335:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139880832 00000100:00100000:1.0:1782241114.379340:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139880832 00000100:00100000:1.0:1782241114.379401:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782241114.379409:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:8168:x1868815139880832:12345-0@lo:502: 00000100:00100000:1.0:1782241114.379537:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:8168:x1868815139880832:12345-0@lo:502: Request processed in 128us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241114.379544:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782241114.383553:0:8168:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c6e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8168:1868815139880832:0@lo:502: 00000020:01000000:0.0:1782241114.383607:0:8168:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241114.383615:0:8168:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241114.383618:0:8168:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1782241114.383628:0:8168:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1782241114.384010:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1782241114.384037:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782241114.384049:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164ca00/0xc9959f2fb1e19415 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1941c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241114.384061:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164ca00/0xc9959f2fb1e19415 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1941c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241114.384072:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782241114.384075:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e48138000 from 1 10000000:01000000:3.0:1782241114.384078:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782241114.384114:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e19423 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241114.384123:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e19423 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241114.384140:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e19423 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241114.384161:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c6e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139880960:0@lo:101: 00000100:00100000:3.0:1782241114.384229:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241114.384281:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e437489c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241114.384346:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139880960 00000100:00100000:1.0:1782241114.384359:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139880960 00000100:00100000:1.0:1782241114.384407:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782241114.384417:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139880960:12345-0@lo:101: 00010000:00010000:1.0:1782241114.384432:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241114.384446:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164dc00/0xc9959f2fb1e1942a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19423 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241114.384470:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164dc00/0xc9959f2fb1e1942a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19423 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241114.384481:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164dc00/0xc9959f2fb1e1942a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19423 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241114.384489:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164dc00, rc 0) 00000100:00100000:1.0:1782241114.384607:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139880960:12345-0@lo:101: Request processed in 190us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241114.384614:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782241114.386859:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c6e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139880960:0@lo:101: 00010000:00010000:0.0:1782241114.386887:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e19423 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1942a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241114.386899:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e19423 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1942a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241114.386979:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139881088:0@lo:501: 00000100:00100000:0.0:1782241114.387034:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241114.387131:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f79b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241114.389897:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139881088 00000100:00100000:1.0:1782241114.389909:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139881088 00000100:00100000:3.0:1782241114.390703:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782241114.390726:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139881088:12345-0@lo:501: 00000100:00100000:3.0:1782241114.390918:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139881088:12345-0@lo:501: Request processed in 193us (3882us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241114.390925:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782241114.391018:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139881088:0@lo:501: 00000100:00100000:2.0:1782241114.391069:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139881216:0@lo:503: 00000100:00100000:2.0:1782241114.391115:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241114.396144:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e7d6186c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241114.396520:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139881216 00000100:00100000:1.0:1782241114.396530:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139881216 00000100:00100000:1.0:1782241114.396579:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782241114.396589:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139881216:12345-0@lo:503: 00000100:00100000:1.0:1782241114.396745:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139881216:12345-0@lo:503: Request processed in 157us (5629us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241114.396753:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782241114.396829:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139881216:0@lo:503: 00000100:00100000:1.0:1782241114.396992:0:8172:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8172:1868815139881344:0@lo:502: 00000100:00100000:1.0:1782241114.397042:0:8172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241114.397062:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139881344 00000100:00100000:1.0:1782241114.397065:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139881344 00000100:00100000:1.0:1782241114.397082:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782241114.397087:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:8172:x1868815139881344:12345-0@lo:502: 00000100:00100000:1.0:1782241114.397152:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:8172:x1868815139881344:12345-0@lo:502: Request processed in 64us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241114.397158:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782241114.397185:0:8172:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aad80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241114.397197:0:8172:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8172:1868815139881344:0@lo:502: 00000020:01000000:1.0:1782241114.397216:0:8172:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241114.397225:0:8172:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241114.397227:0:8172:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782241114.397233:0:8172:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890e48138000 00000020:00000080:1.0:1782241114.397236:0:8172:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782241114.397257:0:8172:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8172:1868815139881472:0@lo:502: 00000100:00100000:1.0:1782241114.397301:0:8172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241114.397319:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139881472 00000100:00100000:1.0:1782241114.397323:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139881472 00000100:00100000:1.0:1782241114.397339:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782241114.397345:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:8172:x1868815139881472:12345-0@lo:502: 00000100:00100000:1.0:1782241114.397400:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:8172:x1868815139881472:12345-0@lo:502: Request processed in 54us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241114.397406:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782241114.397432:0:8172:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aad80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241114.397443:0:8172:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8172:1868815139881472:0@lo:502: 00000020:01000000:1.0:1782241114.397459:0:8172:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241114.397467:0:8172:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241114.397469:0:8172:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1782241114.397473:0:8172:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1782241114.397521:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782241114.397542:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782241114.397551:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e19423 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1942a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241114.397561:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e19423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1942a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241114.762646:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241115.781110:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241116.422273:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241116.422299:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139881600:0@lo:41: 00000100:00100000:3.0:1782241116.422366:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241116.423012:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139881600 00000100:00100000:3.0:1782241116.423020:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139881600 00000100:00100000:3.0:1782241116.423285:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782241116.423296:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139881600:12345-0@lo:41: 00000004:00000024:3.0:1782241116.423334:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1782241116.426255:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139881600:12345-0@lo:41: Request processed in 2952us (3880us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241116.426270:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782241116.426302:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139881600:0@lo:41: 00010000:00010000:3.0:1782241116.805022:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241117.833597:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241117.957894:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139881728:0@lo:400: 00000100:00100000:0.0:1782241117.957971:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241117.958021:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139882240:0@lo:400: 00000100:00100000:0.0:1782241117.958048:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241117.958073:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241117.958079:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139881856:0@lo:400: 00000100:00100000:0.0:1782241117.958120:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241117.958150:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139881984:0@lo:400: 00000100:00100000:0.0:1782241117.958173:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241117.958190:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241117.958220:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139882112:0@lo:400: 00000100:00100000:0.0:1782241117.958245:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241117.958276:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139881728 00000100:00100000:0.0:1782241117.958284:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139881728 00000100:00100000:0.0:1782241117.958329:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782241117.958337:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:3637:x1868815139881728:12345-0@lo:400: 00000100:00100000:0.0:1782241117.958386:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:3637:x1868815139881728:12345-0@lo:400: Request processed in 50us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241117.958394:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782241117.958429:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139882240 00000100:00100000:0.0:1782241117.958433:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139882240 00000100:00100000:0.0:1782241117.958454:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139881984 00000100:00100000:0.0:1782241117.958457:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139881984 00000100:00100000:0.0:1782241117.958474:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782241117.958481:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139882240:12345-0@lo:400: 00000100:00100000:0.0:1782241117.958515:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139882240:12345-0@lo:400: Request processed in 34us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241117.958521:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782241117.958535:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782241117.958540:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139881984:12345-0@lo:400: 00000100:00100000:0.0:1782241117.958570:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139881984:12345-0@lo:400: Request processed in 30us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241117.958576:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782241117.958593:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139881856 00000100:00100000:0.0:1782241117.958597:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139881856 00000100:00100000:0.0:1782241117.958617:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139882112 00000100:00100000:0.0:1782241117.958620:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139882112 00000100:00100000:0.0:1782241117.958634:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782241117.958648:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139881856:12345-0@lo:400: 00000100:00100000:0.0:1782241117.958679:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139881856:12345-0@lo:400: Request processed in 33us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241117.958686:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782241117.958699:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782241117.958704:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139882112:12345-0@lo:400: 00000100:00100000:0.0:1782241117.958729:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139882112:12345-0@lo:400: Request processed in 24us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241117.958735:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1782241117.958802:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890e47aea680 x1868815139881856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241117.958816:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139881856:0@lo:400: 00000100:00100000:0.0:1782241117.958826:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139881728:0@lo:400: 00000100:00100000:0.0:1782241117.958835:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139882240:0@lo:400: 00010000:00080000:0.0:1782241117.958866:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890e47ae9c00 x1868815139882112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241117.958876:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139882112:0@lo:400: 00000100:00100000:0.0:1782241117.958885:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139881984:0@lo:400: 00000100:00100000:1.0:1782241117.966976:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782241117.967004:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139882368:0@lo:41: 00000100:00100000:1.0:1782241117.967071:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241117.967133:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139882368 00000100:00100000:1.0:1782241117.967141:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139882368 00000100:00100000:1.0:1782241117.967186:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782241117.967195:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139882368:12345-0@lo:41: 00000004:00000024:1.0:1782241117.967239:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1782241117.967283:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139882368:12345-0@lo:41: Request processed in 88us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241117.967290:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782241117.967339:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139882368:0@lo:41: 00010000:00010000:3.0:1782241118.853059:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782241119.116140:0:8417:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782241119.116145:0:8417:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1782241119.116146:0:8417:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1782241119.117490:0:8417:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff890e7d6df800 00000020:01000004:3.0:1782241119.117985:0:8417:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1782241119.118003:0:8417:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1782241119.118026:0:8417:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff890e7c690000) 00000020:00000080:3.0:1782241119.118117:0:8417:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1782241119.168103:0:8417:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1782241119.168162:0:8417:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1782241119.197448:0:8417:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1782241119.197655:0:8417:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1782241119.197667:0:8417:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782241119.197678:0:8417:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc9959f2fb1e19438 00000020:01000004:1.0:1782241119.197685:0:8417:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1782241119.197706:0:8417:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.158@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782241119.197715:0:8417:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782241119.197723:0:8417:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1782241119.197729:0:8417:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1782241119.197739:0:8417:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff890e81744d40) 00000020:00000080:1.0:1782241119.197750:0:8417:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1782241119.200870:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782241119.201590:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1782241119.201595:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1782241119.210572:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1782241119.210587:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1782241119.211057:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1782241119.211064:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1782241119.214226:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782241119.214382:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1782241119.214389:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1782241119.219062:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1782241119.219863:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1782241119.259301:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782241119.259845:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782241119.259852:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1782241119.264224:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782241119.264241:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1782241119.266972:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1782241119.267052:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1782241119.276544:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782241119.276720:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1782241119.276725:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1782241119.280569:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1782241119.280582:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1782241119.355445:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782241119.355621:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1782241119.355628:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1782241119.358434:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1782241119.358452:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1782241119.359046:0:8417:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1782241119.359076:0:8417:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1782241119.359083:0:8417:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.158@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1782241119.393141:0:8417:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.158@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782241119.393196:0:8417:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.158@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1782241119.393201:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782241119.393208:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782241119.393209:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241119.393210:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241119.393211:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241119.393213:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241119.393214:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241119.393215:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782241119.393216:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782241119.393217:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241119.393218:0:8417:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782241119.393222:0:8417:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1782241119.393224:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782241119.393225:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782241119.393226:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241119.393227:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241119.393228:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241119.393229:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241119.393230:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241119.393231:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782241119.393231:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782241119.393232:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241119.393233:0:8417:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782241119.393271:0:8417:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782241119.393290:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139882496:0@lo:253: 00000100:00100000:2.0:1782241119.393360:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241119.393501:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e814acc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782241119.396238:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139882496 00000100:00100000:0.0:1782241119.396254:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139882496 00000100:00100000:0.0:1782241119.398204:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782241119.398229:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+18:8417:x1868815139882496:12345-0@lo:253: 20000000:01000000:0.0:1782241119.398286:0:6503:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1782241119.398291:0:6503:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1782241119.398295:0:6503:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1782241119.398298:0:6503:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1782241119.399033:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782241119.399232:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1782241119.399247:0:6503:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1782241119.399264:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1782241119.399271:0:6503:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1782241119.399283:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1782241119.399297:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1782241119.399392:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1782241119.399408:0:6503:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.158@tcp 20000000:01000000:0.0:1782241119.399410:0:6503:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.158@tcp (null) (null) (null) 00000040:00080000:0.0:1782241119.399425:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1782241119.399431:0:6503:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1782241119.399445:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1782241119.399450:0:6503:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.158@tcp (null) (null) 00000040:00080000:0.0:1782241119.399461:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1782241119.399467:0:6503:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1782241119.400201:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1782241119.400227:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1782241119.400310:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1782241119.400324:0:6503:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.158@tcp 20000000:01000000:0.0:1782241119.400325:0:6503:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.158@tcp (null) (null) (null) 00000040:00080000:0.0:1782241119.400339:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1782241119.400344:0:6503:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1782241119.400355:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1782241119.400359:0:6503:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.158@tcp (null) (null) 00000040:00080000:0.0:1782241119.400371:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1782241119.400388:0:6503:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1782241119.400411:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1782241119.400426:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1782241119.401200:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1782241119.401216:0:6503:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.158@tcp 20000000:01000000:0.0:1782241119.401218:0:6503:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.158@tcp (null) (null) (null) 00000040:00080000:0.0:1782241119.401233:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1782241119.401239:0:6503:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782241119.401253:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1782241119.401259:0:6503:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.158@tcp (null) (null) 00000040:00080000:0.0:1782241119.401271:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1782241119.401277:0:6503:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1782241119.401288:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1782241119.401302:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1782241119.401314:0:6503:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1782241119.401317:0:6503:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1782241119.401321:0:6503:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1782241119.401386:0:6503:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782241119.401389:0:6503:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782241119.402050:0:8436:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1782241119.402110:0:8436:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1782241119.402131:0:8436:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1782241119.406848:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1782241119.406897:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1782241119.406913:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1782241119.406927:0:6503:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1782241119.406930:0:6503:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782241119.407465:0:8437:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1782241119.407500:0:8437:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1782241119.407515:0:8437:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1782241119.407836:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1782241119.407859:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1782241119.407874:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1782241119.407885:0:6503:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782241119.407887:0:6503:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782241119.408663:0:8438:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1782241119.409335:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1782241119.409443:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1782241119.409460:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1782241119.409543:0:6503:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1782241119.409546:0:6503:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782241119.410069:0:8439:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1782241119.410104:0:8439:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1782241119.410122:0:8439:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1782241119.413267:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1782241119.413314:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1782241119.413329:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:0.0:1782241119.413898:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782241119.413941:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e19446 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.413966:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e19312 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1930b expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.413974:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e821c2800/0xc9959f2fb1e19389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19382 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.413981:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4b860a00/0xc9959f2fb1e193c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e193ba expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.413988:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e193dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e193d6 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.413995:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e19407 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19400 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.414003:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e19446 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.414052:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e19407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19400 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.414071:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e19407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19400 expref: 18 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241119.414089:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aead80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1868815139882624:0@lo:104: 00000100:00100000:0.0:1782241119.414170:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782241119.414320:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e193dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e193d6 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.414338:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e193dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e193d6 expref: 18 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241119.414346:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1868815139882752:0@lo:104: 00000100:00100000:0.0:1782241119.414379:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782241119.417908:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4b860a00/0xc9959f2fb1e193c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e193ba expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.417930:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e4b860a00/0xc9959f2fb1e193c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e193ba expref: 18 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241119.417949:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aea680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1868815139882880:0@lo:104: 00000100:00100000:0.0:1782241119.418054:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241119.421577:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139882624 00000100:00100000:1.0:1782241119.421598:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139882624 00000100:00100000:1.0:1782241119.421678:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139882752 00000100:00100000:1.0:1782241119.421682:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139882752 00000100:00100000:1.0:1782241119.421705:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782241119.421717:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:6503:x1868815139882624:12345-0@lo:104: 00010000:00010000:1.0:1782241119.421740:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e19400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.421971:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e821c2800/0xc9959f2fb1e19389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19382 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.421986:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e821c2800/0xc9959f2fb1e19389 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19382 expref: 18 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241119.422001:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1868815139883008:0@lo:104: 00000100:00100000:0.0:1782241119.422072:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782241119.422094:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e19312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1930b expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.422103:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e19312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1930b expref: 18 pid: 6504 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241119.422111:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1868815139883136:0@lo:104: 00000100:00100000:0.0:1782241119.422171:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241119.422198:0:6503:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782241119.422666:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aead80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1868815139882624:0@lo:104: 00010000:00010000:1.0:1782241119.423467:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782241119.423488:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:6503:x1868815139882624:12345-0@lo:104: Request processed in 1772us (9316us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241119.423500:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782241119.423541:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139882880 00000100:00100000:1.0:1782241119.423549:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139882880 00000100:00100000:1.0:1782241119.423583:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139883008 00000100:00100000:1.0:1782241119.423586:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139883008 00000100:00100000:1.0:1782241119.423598:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139883136 00000100:00100000:1.0:1782241119.423605:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139883136 00000100:00100000:1.0:1782241119.423620:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782241119.423629:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+6:6503:x1868815139882752:12345-0@lo:104: 00010000:00010000:1.0:1782241119.423656:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e47180600/0xc9959f2fb1e193d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e193dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241119.423868:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1868815139882752:0@lo:104: 00010000:00010000:3.0:1782241119.426277:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241119.426309:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e19400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.426324:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164de00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241119.426329:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e19400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e19407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.426341:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e19400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e19407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241119.426350:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e19400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e19407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241119.426367:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241119.426444:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e19400 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.428634:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241119.428693:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e19400 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.428704:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e19400 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19407 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.428731:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241119.428736:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e47180600/0xc9959f2fb1e193d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e193dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.428745:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e47180600 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241119.428749:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e47180600/0xc9959f2fb1e193d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e193dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.428777:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e47180600/0xc9959f2fb1e193d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e193dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241119.428785:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e47180600/0xc9959f2fb1e193d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e193dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241119.428791:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241119.428846:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e47180600/0xc9959f2fb1e193d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e193dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.428852:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241119.428858:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e47180600/0xc9959f2fb1e193d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e193dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.428864:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e47180600/0xc9959f2fb1e193d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e193dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.428889:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241119.428891:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241119.428895:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241119.428989:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c6e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139883392:0@lo:103: 00000100:00100000:2.0:1782241119.429079:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241119.429188:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782241119.429194:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139883264:0@lo:103: 00000100:00100000:2.0:1782241119.429216:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241119.429465:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139883392 00000100:00100000:3.0:1782241119.429485:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139883392 00010000:00010000:3.0:1782241119.429524:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e193dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e193d6 expref: 19 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241119.429560:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139883264 00000100:00100000:3.0:1782241119.429564:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139883264 00010000:00010000:3.0:1782241119.429577:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e19407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19400 expref: 20 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241119.429592:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782241119.429602:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+20:3640:x1868815139883392:12345-0@lo:103: 00010000:00010000:3.0:1782241119.429619:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241119.429625:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e193dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e193d6 expref: 20 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.429637:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e193dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e193d6 expref: 20 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.429656:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e193dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e193d6 expref: 20 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.429672:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241119.429725:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+19:3640:x1868815139883392:12345-0@lo:103: Request processed in 123us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241119.429733:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782241119.429789:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782241119.429797:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+18:3640:x1868815139883264:12345-0@lo:103: 00010000:00010000:3.0:1782241119.429805:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241119.429809:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e19407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19400 expref: 18 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.429819:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e19407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19400 expref: 18 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.429830:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e19407 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19400 expref: 18 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.429839:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241119.429861:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+17:3640:x1868815139883264:12345-0@lo:103: Request processed in 66us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241119.429867:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782241119.430022:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139883264:0@lo:103: 00000100:00100000:2.0:1782241119.430033:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c6e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139883392:0@lo:103: 00010000:00010000:1.0:1782241119.432620:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1782241119.432647:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+6:6503:x1868815139882752:12345-0@lo:104: Request processed in 9012us (18260us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241119.432662:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782241119.432716:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782241119.432737:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+5:6503:x1868815139882880:12345-0@lo:104: 00010000:00010000:1.0:1782241119.432788:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e193ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e193c1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241119.433020:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aea680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1868815139882880:0@lo:104: 00010000:00010000:1.0:1782241119.441512:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782241119.441541:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+5:6503:x1868815139882880:12345-0@lo:104: Request processed in 8808us (23480us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241119.441557:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782241119.441620:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241119.441640:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:6503:x1868815139883008:12345-0@lo:104: 00010000:00010000:1.0:1782241119.441664:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e19382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19389 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.441808:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782241119.441815:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:6503:x1868815139883008:12345-0@lo:104: Request processed in 187us (19744us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241119.441821:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241119.441834:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782241119.441841:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:6503:x1868815139883136:12345-0@lo:104: 00010000:00010000:1.0:1782241119.441868:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e1930b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19312 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.441902:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782241119.441907:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:6503:x1868815139883136:12345-0@lo:104: Request processed in 67us (19736us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241119.441913:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1782241119.442117:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782241119.442127:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e193ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e193c1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.442137:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c3200 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241119.442142:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e193ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e193c1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.442152:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e193ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e193c1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241119.442160:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e193ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e193c1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.442632:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1782241119.442704:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1868815139883008:0@lo:104: 00000100:00100000:0.0:1782241119.442717:0:6503:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1868815139883136:0@lo:104: 00010000:00010000:0.0:1782241119.442775:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e19446 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.443203:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241119.443289:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e19382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19389 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.443298:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861a00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:0.0:1782241119.443303:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e19382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e19389 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.443313:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e19382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e19389 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241119.443321:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e19382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e19389 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241119.443328:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782241119.443389:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e19382 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19389 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.443397:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782241119.443438:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e19382 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19389 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.443445:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e19382 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19389 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.443461:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241119.443463:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241119.443465:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241119.443490:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139883520:0@lo:103: 00000100:00100000:0.0:1782241119.443556:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241119.443911:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139883520 00000100:00100000:0.0:1782241119.443919:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139883520 00010000:00010000:0.0:1782241119.443951:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e821c2800/0xc9959f2fb1e19389 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19382 expref: 17 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241119.443983:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782241119.443992:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+17:3637:x1868815139883520:12345-0@lo:103: 00010000:00010000:0.0:1782241119.444009:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241119.444015:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e821c2800/0xc9959f2fb1e19389 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19382 expref: 17 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.444027:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e821c2800/0xc9959f2fb1e19389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19382 expref: 17 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.444043:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e821c2800/0xc9959f2fb1e19389 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19382 expref: 17 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.444059:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241119.444102:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+16:3637:x1868815139883520:12345-0@lo:103: Request processed in 110us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241119.444117:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 10000000:01000000:3.0:1782241119.444245:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241119.444269:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e193ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e193c1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.444276:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241119.444285:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e193ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e193c1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.444292:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e193ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e193c1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.444305:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241119.444307:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241119.444309:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241119.445804:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139883648:0@lo:103: 00000100:00100000:3.0:1782241119.445893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241119.446960:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139883648 00000100:00100000:1.0:1782241119.446977:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139883648 00010000:00010000:1.0:1782241119.447028:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4b860a00/0xc9959f2fb1e193c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e193ba expref: 16 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241119.447070:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241119.447080:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+16:3638:x1868815139883648:12345-0@lo:103: 00010000:00010000:1.0:1782241119.447097:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241119.447103:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4b860a00/0xc9959f2fb1e193c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e193ba expref: 16 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.447117:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4b860a00/0xc9959f2fb1e193c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e193ba expref: 16 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.447138:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b860a00/0xc9959f2fb1e193c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e193ba expref: 16 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.447155:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241119.447225:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+15:3638:x1868815139883648:12345-0@lo:103: Request processed in 146us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241119.447232:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782241119.447349:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c6e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139883648:0@lo:103: 00000100:00100000:0.0:1782241119.448669:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139883520:0@lo:103: 00010000:00010000:0.0:1782241119.448875:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241119.448879:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241119.448882:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241119.452618:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e1930b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19312 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.452641:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c400 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241119.452646:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e1930b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e19312 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.452658:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e1930b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e19312 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241119.452665:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e1930b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e19312 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241119.452672:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782241119.456719:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e1930b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19312 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.456741:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782241119.456804:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e1930b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19312 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.456813:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e1930b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19312 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241119.457494:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139883776:0@lo:103: 00000100:00100000:2.0:1782241119.457605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782241119.457882:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241119.457885:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241119.457888:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241119.458749:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139883776 00000100:00100000:3.0:1782241119.458791:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139883776 00010000:00010000:3.0:1782241119.458859:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e19312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1930b expref: 15 pid: 6504 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241119.458906:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782241119.458917:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e477c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62797b42-772f-434f-be35-dfdfcff291e0+15:3639:x1868815139883776:12345-0@lo:103: 00010000:00010000:3.0:1782241119.458936:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241119.458944:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e19312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1930b expref: 15 pid: 6504 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.458958:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e19312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1930b expref: 15 pid: 6504 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.459002:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e19312 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1930b expref: 15 pid: 6504 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.459023:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e19446 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.459033:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e19446 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.459057:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e19446 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.459066:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e19446 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.459074:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e19446 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.459082:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e19446 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.459090:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40030a00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241119.459095:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e19446 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.459105:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e19446 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.459128:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e19446 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.459155:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241119.459247:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e477c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62797b42-772f-434f-be35-dfdfcff291e0+14:3639:x1868815139883776:12345-0@lo:103: Request processed in 330us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241119.459256:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1782241119.459333:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e19446 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.459342:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e19446 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.459348:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e19446 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782241119.459378:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1782241119.459678:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139883776:0@lo:103: 00000100:00100000:0.0:1782241119.463629:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+13:8417:x1868815139882496:12345-0@lo:253: Request processed in 65397us (70255us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241119.463646:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139882496:0@lo:253: 00000100:00100000:0.0:1782241119.463651:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 10000000:01000000:2.0:1782241119.463671:0:8417:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782241119.463677:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782241119.463679:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782241119.463774:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241119.463781:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1782241119.463783:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241119.463784:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241119.463786:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241119.463789:0:8417:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1782241119.463791:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241119.463793:0:8417:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782241119.463826:0:8417:0:(tgt_mount.c:101:server_register_mount()) register mount ffff890e7d6df800 from lustre-OST0000 10000000:01000000:2.0:1782241119.463872:0:8417:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1782241119.463876:0:8417:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1782241119.463886:0:8417:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff890e43633380 local copy 10000000:01000000:2.0:1782241119.463890:0:8417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782241119.463939:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861600/0xc9959f2fb1e1944d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241119.463952:0:8417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.158@tcp lock: ffff890e4b861600/0xc9959f2fb1e1944d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241119.463962:0:8417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b861600/0xc9959f2fb1e1944d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241119.464463:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139883904:0@lo:101: 00000100:00100000:2.0:1782241119.464605:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241119.464834:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139883904 00000100:00100000:0.0:1782241119.464844:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139883904 00000100:00100000:0.0:1782241119.464900:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782241119.464911:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+13:8417:x1868815139883904:12345-0@lo:101: 00010000:00010000:0.0:1782241119.464931:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241119.464952:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e40031e00/0xc9959f2fb1e19454 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1944d expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.465006:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e40031e00/0xc9959f2fb1e19454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1944d expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.465017:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e40031e00/0xc9959f2fb1e19454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1944d expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.465025:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e40031e00, rc 0) 00000100:00100000:0.0:1782241119.465082:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+14:8417:x1868815139883904:12345-0@lo:101: Request processed in 172us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241119.465090:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782241119.465811:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e814ac6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241119.465850:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139883904:0@lo:101: 00010000:00010000:2.0:1782241119.465873:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b861600/0xc9959f2fb1e1944d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc9959f2fb1e19454 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241119.465885:0:8417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b861600/0xc9959f2fb1e1944d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc9959f2fb1e19454 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241119.466574:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139884032:0@lo:501: 00000100:00100000:2.0:1782241119.466637:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241119.466729:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139884032 00000100:00100000:0.0:1782241119.466737:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139884032 00000100:00100000:2.0:1782241119.467414:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e814ac6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241119.469597:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782241119.469632:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+14:8417:x1868815139884032:12345-0@lo:501: 00000100:00100000:0.0:1782241119.469902:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+14:8417:x1868815139884032:12345-0@lo:501: Request processed in 287us (3264us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782241119.469910:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782241119.470073:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139884032:0@lo:501: 10000000:01000000:2.0:1782241119.470104:0:8417:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1782241119.470139:0:8417:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782241119.470150:0:8417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861600/0xc9959f2fb1e1944d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc9959f2fb1e19454 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241119.470163:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861600/0xc9959f2fb1e1944d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc9959f2fb1e19454 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241119.470188:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e4b861600/0xc9959f2fb1e1944d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc9959f2fb1e19454 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241119.470232:0:8417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782241119.470269:0:8417:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff890e7d6df800 10000000:01000000:2.0:1782241119.470275:0:8417:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782241119.470282:0:8417:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1782241119.470285:0:8417:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782241119.470291:0:8417:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 00010000:00010000:1.0:1782241119.470308:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1782241119.470316:0:8417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782241119.470321:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b861600/0xc9959f2fb1e1944d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc9959f2fb1e19454 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.470332:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861600 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241119.470337:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861600/0xc9959f2fb1e1944d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc9959f2fb1e19454 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.470348:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b861600/0xc9959f2fb1e1944d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc9959f2fb1e19454 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241119.470357:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861600/0xc9959f2fb1e1944d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc9959f2fb1e19454 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241119.470364:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782241119.470367:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861200/0xc9959f2fb1e1945b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241119.470377:0:8417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b861200/0xc9959f2fb1e1945b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241119.470389:0:8417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b861200/0xc9959f2fb1e1945b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.470401:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4b861600/0xc9959f2fb1e1944d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc9959f2fb1e19454 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241119.470416:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139884160:0@lo:101: 00010000:00010000:1.0:1782241119.470425:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241119.470456:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b861600/0xc9959f2fb1e1944d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc9959f2fb1e19454 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.470464:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b861600/0xc9959f2fb1e1944d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc9959f2fb1e19454 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241119.470470:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782241119.470543:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241119.470546:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241119.470548:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241119.470564:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139884288:0@lo:103: 00000100:00100000:1.0:1782241119.470597:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241119.470666:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139884288 00000100:00100000:1.0:1782241119.470674:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139884288 00000100:00100000:1.0:1782241119.470717:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241119.470725:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+14:3640:x1868815139884288:12345-0@lo:103: 00010000:00010000:1.0:1782241119.470738:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241119.470752:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e40031e00/0xc9959f2fb1e19454 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1944d expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.470806:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241119.470834:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+13:3640:x1868815139884288:12345-0@lo:103: Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241119.470841:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241119.470868:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139884288:0@lo:103: 00000100:00100000:2.0:1782241119.479220:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e814ac3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241119.479658:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139884160 00000100:00100000:3.0:1782241119.479670:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139884160 00000100:00100000:3.0:1782241119.479737:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782241119.479747:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+13:8417:x1868815139884160:12345-0@lo:101: 00010000:00010000:3.0:1782241119.479806:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241119.479830:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e19462 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1945b expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.479864:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e19462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1945b expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.479876:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e19462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1945b expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.479887:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e47181c00, rc 0) 00000100:00100000:3.0:1782241119.479984:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+14:8417:x1868815139884160:12345-0@lo:101: Request processed in 237us (9515us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241119.479992:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782241119.481324:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139884160:0@lo:101: 00010000:00010000:2.0:1782241119.481367:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b861200/0xc9959f2fb1e1945b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19462 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241119.481382:0:8417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b861200/0xc9959f2fb1e1945b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19462 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241119.481537:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139884416:0@lo:501: 00000100:00100000:2.0:1782241119.481618:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241119.481696:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e814ac3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241119.482522:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139884416 00000100:00100000:0.0:1782241119.482533:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139884416 00000100:00100000:0.0:1782241119.482602:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1782241119.482616:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+14:8417:x1868815139884416:12345-0@lo:501: 00000100:00100000:0.0:1782241119.482864:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+14:8417:x1868815139884416:12345-0@lo:501: Request processed in 251us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241119.482872:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782241119.482963:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139884416:0@lo:501: 00000100:00100000:2.0:1782241119.483031:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139884544:0@lo:503: 00000100:00100000:2.0:1782241119.483090:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241119.483116:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139884544 00000100:00100000:0.0:1782241119.483122:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139884544 00000100:00100000:2.0:1782241119.483138:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e814ac3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241119.483199:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782241119.483214:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+14:8417:x1868815139884544:12345-0@lo:503: 00000100:00100000:0.0:1782241119.483306:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+14:8417:x1868815139884544:12345-0@lo:503: Request processed in 92us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241119.483313:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782241119.483460:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139884544:0@lo:503: 00000040:00080000:2.0:1782241119.485158:0:8417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782241119.485621:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139884672:0@lo:502: 00000100:00100000:2.0:1782241119.485721:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241119.485829:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e814ac6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241119.485851:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139884672 00000100:00100000:3.0:1782241119.485864:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139884672 00000100:00100000:3.0:1782241119.485934:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782241119.485946:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+14:8417:x1868815139884672:12345-0@lo:502: 00000100:00100000:3.0:1782241119.486120:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+14:8417:x1868815139884672:12345-0@lo:502: Request processed in 175us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241119.486130:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782241119.487060:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139884672:0@lo:502: 00000040:00080000:2.0:1782241119.487388:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1782241119.487422:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1782241119.487437:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1782241119.487470:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1782241119.487484:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1782241119.487499:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1782241119.487555:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139884800:0@lo:502: 00000100:00100000:2.0:1782241119.487616:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241119.487669:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e45837480 going to sleep for 11 seconds 00000100:00100000:1.0:1782241119.487703:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139884800 00000100:00100000:1.0:1782241119.487716:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139884800 00000100:00100000:1.0:1782241119.487853:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782241119.487864:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+14:8417:x1868815139884800:12345-0@lo:502: 00000100:00100000:1.0:1782241119.488028:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+14:8417:x1868815139884800:12345-0@lo:502: Request processed in 166us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241119.488046:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782241119.488327:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139884800:0@lo:502: 00000040:00080000:2.0:1782241119.488411:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1782241119.488427:0:8417:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1782241119.493987:0:8442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782241119.494007:0:8442:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1782241119.494015:0:8442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241119.494018:0:8442:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1782241119.494025:0:8442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782241119.494132:0:8442:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff890e503f19c0) 00000020:00000080:0.0:1782241119.494163:0:8442:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1782241119.494180:0:8442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782241119.494298:0:8442:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e7d6df800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1782241119.494308:0:8442:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1782241119.494315:0:8442:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc9959f2fb1e19470 00010000:00010000:2.0:1782241119.503820:0:8442:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1782241119.504252:0:8442:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1782241119.511088:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1782241119.511797:0:8442:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1782241119.525475:0:8442:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1782241119.525678:0:8442:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1782241119.533512:0:8442:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1782241119.536613:0:8442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1782241119.536628:0:8442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241119.536635:0:8442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241119.536637:0:8442:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1782241119.536641:0:8442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241119.536646:0:8442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241119.536647:0:8442:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782241119.536650:0:8442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782241119.536652:0:8442:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1782241119.536679:0:8442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241119.536682:0:8442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241119.536684:0:8442:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782241119.536687:0:8442:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1782241119.537808:0:8417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1782241119.540836:0:8417:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782241119.540885:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861200/0xc9959f2fb1e1945b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19462 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.540901:0:8417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b861200/0xc9959f2fb1e1945b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19462 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241119.540912:0:8417:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e7d6df800 from 1 10000000:01000000:1.0:1782241119.540915:0:8417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782241119.540968:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e19477 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.540978:0:8417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e19477 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.540993:0:8417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e19477 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241119.541023:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139884928:0@lo:101: 00000100:00100000:1.0:1782241119.541117:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241119.541203:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43b9cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241119.541450:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139884928 00000100:00100000:3.0:1782241119.541465:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139884928 00000100:00100000:3.0:1782241119.541529:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782241119.541540:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+14:8417:x1868815139884928:12345-0@lo:101: 00010000:00010000:3.0:1782241119.541569:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241119.541589:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e47180600/0xc9959f2fb1e1947e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19477 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.541630:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e47180600/0xc9959f2fb1e1947e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19477 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.541641:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e47180600/0xc9959f2fb1e1947e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19477 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241119.541650:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e47180600, rc 0) 00000100:00100000:3.0:1782241119.541728:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:8417:x1868815139884928:12345-0@lo:101: Request processed in 190us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241119.541736:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782241119.541809:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139884928:0@lo:101: 00010000:00010000:1.0:1782241119.541833:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e19477 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1947e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.541925:0:8417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e19477 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1947e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241119.542058:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139885056:0@lo:501: 00000100:00100000:1.0:1782241119.542096:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241119.542130:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43b9cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241119.542224:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139885056 00000100:00100000:3.0:1782241119.542231:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139885056 00000100:00100000:3.0:1782241119.542266:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782241119.542275:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:8417:x1868815139885056:12345-0@lo:501: 00000100:00100000:3.0:1782241119.542419:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:8417:x1868815139885056:12345-0@lo:501: Request processed in 145us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241119.542426:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782241119.542906:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139885056:0@lo:501: 00000100:00100000:0.0:1782241119.542957:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139885184:0@lo:503: 00000100:00100000:0.0:1782241119.543034:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241119.543083:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f72600 going to sleep for 11 seconds 00000100:00100000:3.0:1782241119.543344:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139885184 00000100:00100000:3.0:1782241119.543425:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139885184 00000100:00100000:3.0:1782241119.543466:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782241119.543474:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:8417:x1868815139885184:12345-0@lo:503: 00000100:00100000:3.0:1782241119.543573:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:8417:x1868815139885184:12345-0@lo:503: Request processed in 100us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241119.543580:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782241119.543816:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139885184:0@lo:503: 00000040:00080000:2.0:1782241119.545876:0:8417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782241119.545989:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139885312:0@lo:502: 00000100:00100000:3.0:1782241119.552491:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241119.552652:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4776ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1782241119.553558:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139885312 00000100:00100000:1.0:1782241119.553569:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139885312 00000100:00100000:1.0:1782241119.553634:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782241119.553643:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:8417:x1868815139885312:12345-0@lo:502: 00000100:00100000:1.0:1782241119.553811:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:8417:x1868815139885312:12345-0@lo:502: Request processed in 169us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241119.553818:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782241119.554138:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139885312:0@lo:502: 00000040:00080000:2.0:1782241119.554580:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1782241119.554635:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1782241119.554669:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139885440:0@lo:502: 00000100:00100000:2.0:1782241119.554717:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241119.554949:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4776ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241119.561424:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139885440 00000100:00100000:3.0:1782241119.561439:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139885440 00000100:00100000:3.0:1782241119.561558:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782241119.561569:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:8417:x1868815139885440:12345-0@lo:502: 00000100:00100000:3.0:1782241119.561792:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:8417:x1868815139885440:12345-0@lo:502: Request processed in 225us (7074us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241119.561801:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782241119.561907:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139885440:0@lo:502: 00000040:00080000:2.0:1782241119.561990:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1782241119.562006:0:8417:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1782241119.562579:0:8446:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241119.562589:0:8446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241119.562591:0:8446:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782241119.562598:0:8446:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890e7d6df800 00000020:00000080:2.0:1782241119.562600:0:8446:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782241119.562614:0:8446:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241119.562616:0:8446:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241119.562618:0:8446:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1782241119.562620:0:8446:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1782241119.562730:0:8417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1782241119.562783:0:8417:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782241119.562802:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e19477 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1947e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.562813:0:8417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e19477 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1947e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241119.562860:0:8417:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782241119.562863:0:8417:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff890e7d6df800 10000000:01000000:0.0:1782241119.562875:0:8417:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff890e7d6df800 10000000:01000000:0.0:1782241119.562879:0:8417:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782241119.562886:0:8417:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e7d6df800 from 1 10000000:01000000:0.0:1782241119.562888:0:8417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782241119.562920:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e19485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.562930:0:8417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e19485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.562939:0:8417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e19485 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241119.562957:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139885568:0@lo:101: 00000100:00100000:0.0:1782241119.563004:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241119.565037:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f72480 going to sleep for 11 seconds 00000100:00100000:1.0:1782241119.565283:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139885568 00000100:00100000:1.0:1782241119.565293:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139885568 00000100:00100000:1.0:1782241119.565340:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782241119.565349:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:8417:x1868815139885568:12345-0@lo:101: 00010000:00010000:1.0:1782241119.565376:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241119.565393:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164d600/0xc9959f2fb1e1948c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19485 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.565419:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164d600/0xc9959f2fb1e1948c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19485 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.565430:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164d600/0xc9959f2fb1e1948c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19485 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241119.565453:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d600, rc 0) 00000100:00100000:1.0:1782241119.565520:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:8417:x1868815139885568:12345-0@lo:101: Request processed in 170us (2514us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241119.565526:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782241119.566673:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139885568:0@lo:101: 00010000:00010000:0.0:1782241119.566699:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e19485 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1948c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.566710:0:8417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e19485 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1948c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241119.566887:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139885696:0@lo:501: 00000100:00100000:0.0:1782241119.566935:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241119.566976:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f72480 going to sleep for 11 seconds 00000100:00100000:1.0:1782241119.567102:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139885696 00000100:00100000:1.0:1782241119.567108:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139885696 00000100:00100000:1.0:1782241119.567139:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782241119.567147:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:8417:x1868815139885696:12345-0@lo:501: 00000100:00100000:1.0:1782241119.567275:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:8417:x1868815139885696:12345-0@lo:501: Request processed in 128us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241119.567283:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782241119.567558:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139885696:0@lo:501: 00000100:00100000:0.0:1782241119.567583:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139885824:0@lo:503: 00000100:00100000:0.0:1782241119.567650:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241119.567686:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f72480 going to sleep for 11 seconds 00000100:00100000:1.0:1782241119.567822:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139885824 00000100:00100000:1.0:1782241119.567828:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139885824 00000100:00100000:1.0:1782241119.567848:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782241119.567861:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:8417:x1868815139885824:12345-0@lo:503: 00000100:00100000:1.0:1782241119.567945:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:8417:x1868815139885824:12345-0@lo:503: Request processed in 89us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241119.567951:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782241119.568083:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139885824:0@lo:503: 00000040:00080000:0.0:1782241119.568588:0:8417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782241119.568751:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139885952:0@lo:502: 00000100:00100000:0.0:1782241119.568822:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241119.568971:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f72480 going to sleep for 11 seconds 00000100:00100000:3.0:1782241119.569385:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139885952 00000100:00100000:3.0:1782241119.569393:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139885952 00000100:00100000:1.0:1782241119.569574:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782241119.569585:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:8417:x1868815139885952:12345-0@lo:502: 00000100:00100000:1.0:1782241119.569721:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:8417:x1868815139885952:12345-0@lo:502: Request processed in 138us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241119.569729:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782241119.569881:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139885952:0@lo:502: 00000040:00080000:0.0:1782241119.570101:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1782241119.570132:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1782241119.570146:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1782241119.570159:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1782241119.570194:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1782241119.570210:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1782241119.570222:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1782241119.570234:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1782241119.570246:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1782241119.570259:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1782241119.570273:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1782241119.570285:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1782241119.570297:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1782241119.570311:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1782241119.570323:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1782241119.570336:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1782241119.570560:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1782241119.570587:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1782241119.570603:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1782241119.570617:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1782241119.570642:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1782241119.570657:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1782241119.570683:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1782241119.570698:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1782241119.570712:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1782241119.570726:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1782241119.570738:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1782241119.570748:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1782241119.570781:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1782241119.570796:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1782241119.570809:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1782241119.570821:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1782241119.570832:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1782241119.570847:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1782241119.570861:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1782241119.570874:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1782241119.570901:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1782241119.570942:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139886080:0@lo:502: 00000100:00100000:0.0:1782241119.570999:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241119.571168:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f72480 going to sleep for 11 seconds 00000100:00100000:1.0:1782241119.571439:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139886080 00000100:00100000:1.0:1782241119.571447:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139886080 00000100:00100000:1.0:1782241119.571494:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782241119.571503:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:8417:x1868815139886080:12345-0@lo:502: 00000100:00100000:1.0:1782241119.571630:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:8417:x1868815139886080:12345-0@lo:502: Request processed in 128us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241119.571638:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782241119.571866:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139886080:0@lo:502: 00000040:00080000:0.0:1782241119.571920:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1782241119.571932:0:8417:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1782241119.574664:0:8447:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1782241119.574683:0:8447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff890e503f4d40) 00000020:00000080:0.0:1782241119.574706:0:8447:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1782241119.575226:0:8447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e7d6df800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1782241119.575231:0:8447:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e7d6df800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1782241119.575234:0:8447:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e7d6df800 3 00010000:00080000:0.0:1782241119.575264:0:8447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d45a7f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.158@tcp at head 00010000:00010000:0.0:1782241119.577534:0:8447:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1782241119.577750:0:8447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1782241119.577964:0:8447:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782241119.577975:0:8447:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc9959f2fb1e1949a 00000100:00080000:0.0:1782241119.577985:0:8447:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782241119.577991:0:8447:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff890d45a7f800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241119.578086:0:8447:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a48380 x1868815139886208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782241119.578203:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1868815139886208:0@lo:38: 00000100:00100000:3.0:1782241119.578269:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241119.578363:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139886208 00000100:00100000:1.0:1782241119.578370:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139886208 00000100:00100000:1.0:1782241119.578400:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782241119.578408:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1868815139886208:12345-0@lo:38: 00010000:00080000:1.0:1782241119.578429:0:6511:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:1.0:1782241119.578457:0:6511:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc9959f2fb1e194a1 00000004:00100000:1.0:1782241119.578470:0:6511:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782241119.578495:0:6511:0:(import.c:65:import_set_state_nolock()) ffff890d45a47800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1782241119.578547:0:8447:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1782241119.585677:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1868815139886208:12345-0@lo:38: Request processed in 7259us (7397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241119.585692:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1782241119.585990:0:8447:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1782241119.586005:0:8447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff890e503f0000) 00000020:00000080:0.0:1782241119.586027:0:8447:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1782241119.586194:0:8447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e7d6df800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1782241119.586199:0:8447:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e7d6df800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1782241119.586201:0:8447:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e7d6df800 3 00010000:00080000:0.0:1782241119.586228:0:8447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d46661800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.158@tcp at head 00010000:00080000:3.0:1782241119.589744:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890d45a48380 x1868815139886208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241119.589773:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782241119.589784:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1782241119.589793:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1782241119.589799:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782241119.589802:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d45a7f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782241119.589810:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1868815139886208:0@lo:38: 00000100:00100000:3.0:1782241119.589935:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139886336:0@lo:400: 00000100:00100000:1.0:1782241119.589935:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c6e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139886720:0@lo:400: 00000100:00100000:3.0:1782241119.590691:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241119.590736:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241119.590743:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139886464:0@lo:400: 00000100:00100000:3.0:1782241119.590822:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241119.590871:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139886592:0@lo:400: 00000100:00100000:3.0:1782241119.590902:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241119.590942:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139886464 00000100:00100000:3.0:1782241119.590948:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139886464 00000100:00100000:3.0:1782241119.590989:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782241119.590998:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139886464:12345-0@lo:400: 00000100:00100000:3.0:1782241119.591053:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139886464:12345-0@lo:400: Request processed in 55us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241119.591060:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782241119.591082:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139886336 00000100:00100000:3.0:1782241119.591085:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139886336 00000100:00100000:2.0:1782241119.591874:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139886592 00000100:00100000:2.0:1782241119.591881:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139886592 00000100:00100000:2.0:1782241119.591921:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782241119.591929:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139886592:12345-0@lo:400: 00000100:00100000:2.0:1782241119.591997:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139886592:12345-0@lo:400: Request processed in 68us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241119.592004:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241119.592094:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241119.592138:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139886720 00000100:00100000:1.0:1782241119.592142:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139886720 00000100:00100000:1.0:1782241119.592167:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782241119.592184:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139886720:12345-0@lo:400: 00000100:00100000:1.0:1782241119.592235:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139886720:12345-0@lo:400: Request processed in 51us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241119.592241:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782241119.592275:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c6e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139886720:0@lo:400: 00000100:00100000:3.0:1782241119.592539:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782241119.592546:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139886336:12345-0@lo:400: 00000100:00100000:3.0:1782241119.592581:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139886336:12345-0@lo:400: Request processed in 36us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241119.592587:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1782241119.592788:0:8447:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1782241119.592882:0:8447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1782241119.592921:0:8447:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782241119.592932:0:8447:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc9959f2fb1e194af 00000100:00080000:0.0:1782241119.592939:0:8447:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782241119.592945:0:8447:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff890d46661800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241119.592972:0:8447:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a48700 x1868815139886848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241119.592993:0:8447:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:0.0:1782241119.593185:0:8447:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1782241119.593627:0:8417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1782241119.593655:0:8417:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782241119.593680:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e19485 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1948c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241119.593691:0:8417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e19485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1948c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782241119.593742:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782241119.593744:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782241119.593746:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241119.593747:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241119.593748:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241119.593750:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241119.593751:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241119.593753:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782241119.593774:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782241119.593776:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241119.593777:0:8417:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782241119.593780:0:8417:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1782241119.593783:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782241119.593784:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782241119.593785:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241119.593786:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241119.593787:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241119.593788:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241119.593789:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241119.593790:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782241119.593791:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782241119.593792:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241119.593793:0:8417:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782241119.593810:0:8417:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782241119.593824:0:8417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139886976:0@lo:253: 00000100:00100000:2.0:1782241119.593873:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241119.593919:0:8417:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4776ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1782241119.593938:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139886976 00000100:00100000:2.0:1782241119.593943:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139886976 00000100:00100000:2.0:1782241119.593977:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782241119.593985:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+16:8417:x1868815139886976:12345-0@lo:253: 20000000:01000000:2.0:1782241119.594008:0:6504:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1782241119.594035:0:6504:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1782241119.594548:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890e7c6e5c00 x1868815139886592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241119.594561:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c6e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139886592:0@lo:400: 00000100:00100000:3.0:1782241119.594662:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139886464:0@lo:400: 00010000:00080000:3.0:1782241119.594675:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890e7c6e4380 x1868815139886336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241119.594684:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139886336:0@lo:400: 00000100:00100000:3.0:1782241119.594707:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1868815139886848:0@lo:38: 00000100:00100000:3.0:1782241119.594746:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241119.594936:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139886848 00000100:00100000:2.0:1782241119.594947:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139886848 00000100:00100000:2.0:1782241119.595261:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782241119.595269:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1868815139886848:12345-0@lo:38: 00010000:00080000:2.0:1782241119.595293:0:6512:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:2.0:1782241119.595329:0:6512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc9959f2fb1e194b6 00000004:00100000:2.0:1782241119.595345:0:6512:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782241119.595460:0:6512:0:(import.c:65:import_set_state_nolock()) ffff890d45a63800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241119.595533:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1868815139886848:12345-0@lo:38: Request processed in 262us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241119.595541:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1782241119.595613:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890d45a48700 x1868815139886848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241119.595630:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782241119.595638:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1782241119.595645:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1782241119.595650:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1782241119.595653:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d46661800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782241119.595659:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1868815139886848:0@lo:38: 20000000:01000000:0.0:1782241119.601159:0:6504:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782241119.601191:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1782241119.601508:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782241119.601513:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782241119.601537:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241119.601555:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e821c2200/0xc9959f2fb1e193b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e193ac expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241119.601564:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e193cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e193c8 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241119.601573:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194bd lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241119.601624:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e193cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e193c8 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241119.601639:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e193cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e193c8 expref: 16 pid: 6505 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241119.601666:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1868815139887104:0@lo:104: 00000100:00100000:2.0:1782241119.601733:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241119.601832:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e821c2200/0xc9959f2fb1e193b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e193ac expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241119.601841:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e821c2200/0xc9959f2fb1e193b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e193ac expref: 16 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241119.601850:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1868815139887232:0@lo:104: 00000100:00100000:2.0:1782241119.601869:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4776ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1782241119.602507:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782241119.602529:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241119.602569:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139887104 00000100:00100000:0.0:1782241119.602575:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139887104 00000100:00100000:0.0:1782241119.602622:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139887232 00000100:00100000:0.0:1782241119.602626:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139887232 00000100:00100000:0.0:1782241119.602639:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782241119.602646:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d760050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+4:6526:x1868815139887104:12345-0@lo:104: 00010000:00010000:0.0:1782241119.602660:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e193c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e193cf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.602739:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782241119.602746:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d760050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+4:6526:x1868815139887104:12345-0@lo:104: Request processed in 100us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241119.602752:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782241119.602811:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782241119.602818:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+3:6526:x1868815139887232:12345-0@lo:104: 00010000:00010000:0.0:1782241119.602825:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e193ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e193b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.602863:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782241119.602868:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+3:6526:x1868815139887232:12345-0@lo:104: Request processed in 51us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241119.602874:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1782241119.602895:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782241119.602901:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e193c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e193cf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.602908:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c3800 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:0.0:1782241119.602912:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e193c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e193cf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.602931:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e193c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e193cf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241119.602939:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e193c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e193cf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241119.602945:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782241119.602973:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e193c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e193cf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.602979:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782241119.602998:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e193c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e193cf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.603005:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e193c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e193cf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.603018:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241119.603021:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e193ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e193b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.603026:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860000 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:0.0:1782241119.603028:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e193ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e193b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.603034:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e193ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e193b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241119.603041:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e193ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e193b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241119.603052:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782241119.603065:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e193ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e193b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.603071:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782241119.603076:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e193ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e193b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.603082:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e193ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e193b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.603546:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241119.603549:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241119.603551:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241119.603561:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241119.603575:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139887488:0@lo:103: 00000100:00100000:2.0:1782241119.603782:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+16:8417:x1868815139886976:12345-0@lo:253: Request processed in 9796us (9906us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241119.603792:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782241119.603847:0:8417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:8417:1868815139886976:0@lo:253: 10000000:01000000:2.0:1782241119.603860:0:8417:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782241119.603863:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782241119.603864:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782241119.603865:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241119.603866:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241119.603867:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241119.603869:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241119.603870:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241119.603872:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782241119.603873:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782241119.603875:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241119.603876:0:8417:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782241119.603888:0:8417:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1782241119.605226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241119.605299:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241119.605310:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139887360:0@lo:103: 00000100:00100000:0.0:1782241119.605336:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241119.605377:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139887488 00000100:00100000:0.0:1782241119.605383:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139887488 00010000:00010000:0.0:1782241119.605412:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e821c2200/0xc9959f2fb1e193b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e193ac expref: 16 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241119.605437:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139887360 00000100:00100000:0.0:1782241119.605440:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139887360 00010000:00010000:0.0:1782241119.605451:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e193cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e193c8 expref: 17 pid: 6505 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241119.605480:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782241119.605488:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+17:3638:x1868815139887488:12345-0@lo:103: 00010000:00010000:0.0:1782241119.605502:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241119.605508:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e821c2200/0xc9959f2fb1e193b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e193ac expref: 17 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.605518:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e821c2200/0xc9959f2fb1e193b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e193ac expref: 17 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.605536:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241119.605575:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+17:3638:x1868815139887488:12345-0@lo:103: Request processed in 87us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241119.605582:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782241119.607408:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782241119.607423:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+16:3638:x1868815139887360:12345-0@lo:103: 00010000:00010000:0.0:1782241119.607439:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241119.607446:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e193cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e193c8 expref: 16 pid: 6505 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.607458:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e193cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e193c8 expref: 16 pid: 6505 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.607476:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194bd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.607484:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194bd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782241119.607516:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006003369s 00010000:00010000:0.0:1782241119.607522:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.607528:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.607535:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194bd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.607541:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.607547:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241119.607551:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.607558:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194bd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.607567:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194bd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.607577:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241119.607651:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+16:3638:x1868815139887360:12345-0@lo:103: Request processed in 233us (2314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241119.607658:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1782241119.607719:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e193cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e193c8 expref: 15 pid: 6505 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241119.607743:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1868815139887104:0@lo:104: 00010000:00010000:0.0:1782241119.607787:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e821c2200/0xc9959f2fb1e193b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e193ac expref: 14 pid: 6503 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241119.607798:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1868815139887232:0@lo:104: 00010000:00010000:0.0:1782241119.607818:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.607827:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.607833:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241119.607839:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194bd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241119.607869:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139887360:0@lo:103: 00000100:00100000:0.0:1782241119.607877:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139887488:0@lo:103: 00080000:10000000:2.0:1782241119.613737:0:8417:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1782241119.613931:0:8417:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1782241119.614123:0:8417:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1782241119.614303:0:8417:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1782241119.614529:0:8417:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1782241119.614750:0:8417:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1782241119.622969:0:8417:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1782241119.648790:0:8417:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1782241119.648806:0:8417:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1782241119.648859:0:8417:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782241119.648927:0:8417:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.158@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782241119.648965:0:8417:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1782241119.649019:0:8417:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1782241119.652112:0:8417:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782241119.652406:0:8417:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1782241119.877472:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782241120.614644:0:8504:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782241120.614878:0:8504:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782241120.902874:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241121.541623:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139887616:0@lo:41: 00000100:00100000:1.0:1782241121.541698:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241121.541812:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139887616 00000100:00100000:2.0:1782241121.541820:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139887616 00000100:00100000:2.0:1782241121.541869:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782241121.541879:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139887616:12345-0@lo:41: 00000004:00000024:2.0:1782241121.541915:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1782241121.544322:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139887616:12345-0@lo:41: Request processed in 2436us (2616us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241121.544336:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782241121.546609:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139887616:0@lo:41: 00010000:00010000:2.0:1782241121.925951:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241122.956243:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241123.078618:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241123.078647:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139887744:0@lo:41: 00000100:00100000:3.0:1782241123.078830:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241123.079083:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139887744 00000100:00100000:0.0:1782241123.079091:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139887744 00000100:00100000:0.0:1782241123.079154:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782241123.079164:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139887744:12345-0@lo:41: 00000004:00000024:0.0:1782241123.079209:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1782241123.079290:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139887744:12345-0@lo:41: Request processed in 127us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241123.079311:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782241123.079404:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139887744:0@lo:41: 00010000:00010000:0.0:1782241123.973878:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241124.613144:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139888000:0@lo:400: 00000100:00100000:3.0:1782241124.613219:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241124.613265:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139888512:0@lo:400: 00000100:00100000:3.0:1782241124.613286:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241124.613314:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782241124.613320:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139887872:0@lo:400: 00000100:00100000:3.0:1782241124.613351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241124.613368:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139888384:0@lo:400: 00000100:00100000:3.0:1782241124.613390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241124.613424:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139888128:0@lo:400: 00000100:00100000:3.0:1782241124.613450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241124.613450:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815139888256:0@lo:400: 00000100:00100000:3.0:1782241124.613470:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139888640:0@lo:400: 00000100:00100000:2.0:1782241124.613492:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241124.613511:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139888000 00000100:00100000:3.0:1782241124.613518:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139888000 00000100:00100000:3.0:1782241124.613556:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139888512 00000100:00100000:3.0:1782241124.613559:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139888512 00000100:00100000:3.0:1782241124.613583:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139888256 00000100:00100000:3.0:1782241124.613586:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139888256 00000100:00100000:3.0:1782241124.613600:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782241124.613608:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139888000:12345-0@lo:400: 00000100:00100000:3.0:1782241124.613660:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139888000:12345-0@lo:400: Request processed in 52us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241124.613667:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782241124.613684:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782241124.613691:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139888512:12345-0@lo:400: 00000100:00100000:3.0:1782241124.613718:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139888512:12345-0@lo:400: Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241124.613724:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782241124.613734:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782241124.613740:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815139888256:12345-0@lo:400: 00000100:00100000:3.0:1782241124.613787:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815139888256:12345-0@lo:400: Request processed in 47us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241124.613794:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782241124.613812:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139888384 00000100:00100000:3.0:1782241124.613815:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139888384 00000100:00100000:3.0:1782241124.613834:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139888128 00000100:00100000:3.0:1782241124.613844:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139888128 00000100:00100000:3.0:1782241124.613859:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782241124.613865:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139888384:12345-0@lo:400: 00000100:00100000:3.0:1782241124.613895:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139888384:12345-0@lo:400: Request processed in 31us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241124.613902:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782241124.613911:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782241124.613917:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139888128:12345-0@lo:400: 00000100:00100000:3.0:1782241124.613937:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139888128:12345-0@lo:400: Request processed in 21us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241124.613944:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782241124.613977:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139888384:0@lo:400: 00010000:00080000:3.0:1782241124.613991:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676e680 x1868815139888000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241124.614000:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139888000:0@lo:400: 00010000:00080000:3.0:1782241124.614009:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676c000 x1868815139888512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241124.614018:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139888512:0@lo:400: 00000100:00100000:3.0:1782241124.614062:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241124.614104:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139888128:0@lo:400: 00000100:00100000:3.0:1782241124.614125:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139888640 00000100:00100000:3.0:1782241124.614128:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139888640 00000100:00100000:3.0:1782241124.614150:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782241124.614155:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139888640:12345-0@lo:400: 00000100:00100000:3.0:1782241124.614187:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139888640:12345-0@lo:400: Request processed in 31us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241124.614199:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782241124.614206:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139887872 00000100:00100000:2.0:1782241124.614213:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139887872 00010000:00080000:3.0:1782241124.614233:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676d880 x1868815139888640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241124.614243:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139888640:0@lo:400: 00000100:00100000:2.0:1782241124.614250:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782241124.614260:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+14:3638:x1868815139887872:12345-0@lo:400: 00000100:00080000:3.0:1782241124.614271:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782241124.614276:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782241124.614295:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676fb80 x1868815139888256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241124.614304:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815139888256:0@lo:400: 00000100:00100000:2.0:1782241124.614323:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+14:3638:x1868815139887872:12345-0@lo:400: Request processed in 64us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241124.614333:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782241124.614359:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139887872:0@lo:400: 10000000:01000000:2.0:1782241124.614940:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782241124.614944:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e43609000 from 30 10000000:01000000:2.0:1782241124.614948:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782241124.614981:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e194c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.615003:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e194c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.616849:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e194c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241124.616883:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139888768:0@lo:101: 00000100:00100000:2.0:1782241124.616943:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241124.617003:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afd780 going to sleep for 11 seconds 00000100:00100000:2.0:1782241124.617027:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139888768 00000100:00100000:2.0:1782241124.617033:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139888768 00000100:00100000:2.0:1782241124.617685:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1782241124.617696:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+14:6508:x1868815139888768:12345-0@lo:101: 00010000:00010000:2.0:1782241124.617709:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241124.617724:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e194c4 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.617748:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e194c4 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.617855:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e194c4 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.617864:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861600, rc 0) 00000100:00100000:2.0:1782241124.617922:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:6508:x1868815139888768:12345-0@lo:101: Request processed in 228us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241124.617929:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1782241124.617987:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139888768:0@lo:101: 00010000:00010000:2.0:1782241124.618015:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e194c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e194cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.618024:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e194c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e194cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241124.619069:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139888896:0@lo:501: 00000100:00100000:2.0:1782241124.619920:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241124.619984:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afd780 going to sleep for 11 seconds 00000100:00100000:2.0:1782241124.620010:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139888896 00000100:00100000:2.0:1782241124.620016:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139888896 00000100:00100000:2.0:1782241124.620136:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782241124.620147:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:6508:x1868815139888896:12345-0@lo:501: 00000100:00100000:2.0:1782241124.620301:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:6508:x1868815139888896:12345-0@lo:501: Request processed in 155us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241124.620310:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782241124.620538:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139888896:0@lo:501: 00000100:00100000:2.0:1782241124.620672:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139889024:0@lo:503: 00000100:00100000:2.0:1782241124.620719:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241124.620894:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4776e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241124.620945:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139889024 00000100:00100000:1.0:1782241124.620950:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139889024 00000100:00100000:1.0:1782241124.624055:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782241124.624097:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:6508:x1868815139889024:12345-0@lo:503: 00000100:00100000:1.0:1782241124.624266:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:6508:x1868815139889024:12345-0@lo:503: Request processed in 197us (3547us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241124.624275:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782241124.624318:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139889024:0@lo:503: 00000100:00100000:0.0:1782241124.625631:0:8736:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8736:1868815139889152:0@lo:502: 00000100:00100000:0.0:1782241124.625694:0:8736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241124.625782:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139889152 00000100:00100000:1.0:1782241124.625790:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139889152 00000100:00100000:1.0:1782241124.625831:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782241124.625840:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e49385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:8736:x1868815139889152:12345-0@lo:502: 00000100:00100000:0.0:1782241124.625870:0:8736:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241124.626551:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e49385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:8736:x1868815139889152:12345-0@lo:502: Request processed in 709us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241124.626840:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782241124.627200:0:8736:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8736:1868815139889152:0@lo:502: 00000100:00100000:0.0:1782241124.627262:0:8736:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8736:1868815139889280:0@lo:502: 00000100:00100000:0.0:1782241124.627309:0:8736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241124.627351:0:8736:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810240 going to sleep for 11 seconds 00000100:00100000:1.0:1782241124.630238:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139889280 00000100:00100000:1.0:1782241124.630252:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139889280 00000100:00100000:1.0:1782241124.630317:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782241124.630328:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e438c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:8736:x1868815139889280:12345-0@lo:502: 00000100:00100000:1.0:1782241124.630480:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e438c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:8736:x1868815139889280:12345-0@lo:502: Request processed in 153us (3170us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241124.630495:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782241124.630565:0:8736:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8736:1868815139889280:0@lo:502: 00000040:00080000:1.0:1782241124.630611:0:8736:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1782241124.630695:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1782241124.630724:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782241124.630735:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e194c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e194cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241124.630746:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e194c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e194cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241124.631097:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782241124.631113:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890e43609000 from 5 10000000:01000000:1.0:1782241124.631116:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782241124.631150:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e194d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.631159:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e194d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.631169:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e194d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241124.631188:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139889408:0@lo:101: 00000100:00100000:1.0:1782241124.631230:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241124.631264:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863900 going to sleep for 11 seconds 00000100:00100000:0.0:1782241124.631831:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139889408 00000100:00100000:0.0:1782241124.631840:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139889408 00000100:00100000:0.0:1782241124.631889:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782241124.631975:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e438c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:6508:x1868815139889408:12345-0@lo:101: 00010000:00010000:0.0:1782241124.631989:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241124.632003:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e40030600/0xc9959f2fb1e194d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e194d2 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241124.632042:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e40030600/0xc9959f2fb1e194d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e194d2 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241124.632053:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e40030600/0xc9959f2fb1e194d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e194d2 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241124.632062:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e40030600, rc 0) 00000100:00100000:0.0:1782241124.632154:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e438c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139889408:12345-0@lo:101: Request processed in 256us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241124.632160:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782241124.632736:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139889408:0@lo:101: 00010000:00010000:1.0:1782241124.632754:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e194d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e194d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.632797:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e194d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e194d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241124.632859:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139889536:0@lo:256: 00000100:00100000:1.0:1782241124.632897:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241124.632945:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863900 going to sleep for 11 seconds 00000100:00100000:3.0:1782241124.633001:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139889536 00000100:00100000:3.0:1782241124.633007:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139889536 00000100:00100000:3.0:1782241124.633045:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782241124.633052:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e438c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139889536:12345-0@lo:256: 20000000:01000000:3.0:1782241124.633067:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782241124.633092:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782241124.633096:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1782241124.633182:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e438c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139889536:12345-0@lo:256: Request processed in 130us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241124.633190:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782241124.633305:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139889536:0@lo:256: 10000000:01000000:0.0:1782241124.633348:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782241124.633354:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e194d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e194d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241124.633363:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e194d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e194d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241124.633370:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1782241124.633373:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1782241124.633375:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1782241124.633394:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e194e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241124.633401:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e194e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241124.633408:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e194e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241124.633425:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139889664:0@lo:101: 00000100:00100000:0.0:1782241124.633452:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241124.633813:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139889664 00000100:00100000:1.0:1782241124.633819:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139889664 00000100:00100000:1.0:1782241124.633857:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782241124.633864:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139889664:12345-0@lo:101: 00010000:00010000:1.0:1782241124.633873:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241124.633885:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e194e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e194e0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.633915:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e194e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e194e0 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.633925:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e194e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e194e0 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.633933:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c000, rc 0) 00000100:00100000:0.0:1782241124.634059:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241124.635575:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139889664:12345-0@lo:101: Request processed in 1703us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241124.635586:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782241124.645055:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139889664:0@lo:101: 00010000:00010000:0.0:1782241124.645098:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e194e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e194e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241124.645112:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e194e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e194e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241124.646122:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139889792:0@lo:501: 00000100:00100000:0.0:1782241124.646187:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241124.646261:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241124.646304:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139889792 00000100:00100000:3.0:1782241124.646311:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139889792 00000100:00100000:3.0:1782241124.646362:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782241124.646371:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139889792:12345-0@lo:501: 00000100:00100000:3.0:1782241124.646499:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139889792:12345-0@lo:501: Request processed in 128us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241124.646512:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782241124.646709:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139889792:0@lo:501: 00000100:00100000:0.0:1782241124.646742:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139889920:0@lo:503: 00000100:00100000:0.0:1782241124.646804:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241124.646839:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241124.647082:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139889920 00000100:00100000:3.0:1782241124.647087:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139889920 00000100:00100000:3.0:1782241124.647134:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782241124.647142:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139889920:12345-0@lo:503: 00000100:00100000:0.0:1782241124.647271:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139889920:0@lo:503: 00000100:00100000:3.0:1782241124.647391:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139889920:12345-0@lo:503: Request processed in 103us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241124.647399:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782241124.647563:0:8737:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8737:1868815139890048:0@lo:502: 00000100:00100000:0.0:1782241124.647603:0:8737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241124.647646:0:8737:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782241124.647682:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139890048 00000100:00100000:3.0:1782241124.647688:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139890048 00000100:00100000:3.0:1782241124.647725:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782241124.647733:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:8737:x1868815139890048:12345-0@lo:502: 00000100:00100000:3.0:1782241124.647857:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:8737:x1868815139890048:12345-0@lo:502: Request processed in 125us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241124.647864:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782241124.648014:0:8737:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8737:1868815139890048:0@lo:502: 00000020:01000000:0.0:1782241124.648036:0:8737:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782241124.648043:0:8737:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1782241124.648055:0:8737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241124.648058:0:8737:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1782241124.648062:0:8737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782241124.648066:0:8737:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:01000000:0.0:1782241124.648102:0:8737:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1782241124.648106:0:8737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782241124.648131:0:8737:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff890d46740000) 00000020:00000080:0.0:1782241124.648154:0:8737:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1782241124.648161:0:8737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782241124.648236:0:8737:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1782241124.648244:0:8737:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1782241124.648251:0:8737:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e194f5 00010000:00080000:0.0:1782241124.648280:0:8737:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d45a79800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.158@tcp at head 00010000:00010000:0.0:1782241124.649642:0:8737:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1782241124.664748:0:8737:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1782241124.665363:0:8737:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1782241124.665566:0:8737:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782241124.667630:0:8737:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782241124.667727:0:8737:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1782241124.667858:0:8737:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1782241124.670239:0:8738:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782241124.670258:0:8738:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1782241124.671164:0:8737:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1782241124.671178:0:8737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782241124.671216:0:8737:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1782241124.671239:0:8737:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e194fc 00000100:00080000:3.0:1782241124.671357:0:8737:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782241124.671363:0:8737:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff890d45a79800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241124.671399:0:8737:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d4676f100 x1868815139890176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782241124.671428:0:8737:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1782241124.671511:0:8737:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241124.671522:0:8737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241124.671524:0:8737:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1782241124.671528:0:8737:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241124.671532:0:8737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241124.671534:0:8737:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782241124.671537:0:8737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782241124.671538:0:8737:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1782241124.671566:0:8737:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8737:1868815139890304:0@lo:502: 00000100:00100000:1.0:1782241124.671674:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815139890176:0@lo:8: 00000100:00100000:3.0:1782241124.671822:0:8737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241124.671867:0:8737:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77983d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782241124.672220:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139890304 00000100:00100000:0.0:1782241124.672228:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139890304 00000100:00100000:0.0:1782241124.672287:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782241124.672296:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:8737:x1868815139890304:12345-0@lo:502: 00000100:00100000:1.0:1782241124.674967:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241124.675105:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139890176 00000100:00100000:2.0:1782241124.675115:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139890176 00000100:00100000:2.0:1782241124.675158:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241124.675166:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1868815139890176:12345-0@lo:8: 00010000:00080000:2.0:1782241124.675198:0:8423:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:2.0:1782241124.675228:0:8423:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e19503 00002000:00100000:2.0:1782241124.675499:0:8423:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff890d45a60800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1782241124.675510:0:8423:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1782241124.675514:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1782241124.675652:0:8423:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1782241124.676733:0:8423:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1782241124.676797:0:8423:0:(import.c:65:import_set_state_nolock()) ffff890d45a66800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241124.676912:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1868815139890176:12345-0@lo:8: Request processed in 1744us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241124.676924:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782241124.677002:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676f100 x1868815139890176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782241134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241124.677015:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782241124.677024:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1782241124.677032:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782241124.677037:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1782241124.677040:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d45a79800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782241124.677054:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782241124.677060:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815139890176:0@lo:8: 00000100:00100000:2.0:1782241124.677154:0:8739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8739:1868815139890432:0@lo:700: 00000100:00100000:2.0:1782241124.677191:0:8739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241124.677229:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139890432 00000100:00100000:2.0:1782241124.677235:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139890432 00000100:00100000:2.0:1782241124.677885:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241124.677897:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8739:x1868815139890432:12345-0@lo:700: 00000100:00100000:2.0:1782241124.677935:0:8432:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8432:1868815139890560:0@lo:700: 00000100:00100000:2.0:1782241124.677973:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241124.678000:0:8432:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4776eb40 going to sleep for 11 seconds 00000100:00080000:2.0:1782241124.678025:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241124.678042:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139890560 00000100:00100000:2.0:1782241124.678046:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139890560 00000100:00100000:2.0:1782241124.678090:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241124.678097:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8432:x1868815139890560:12345-0@lo:700: 00000100:00100000:2.0:1782241124.678194:0:8739:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4776e840 going to sleep for 11 seconds 00000004:00080000:2.0:1782241124.678207:0:8738:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1782241124.678273:0:8738:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 187936515752ns, next at 0ns, rc = 0 00080000:00080000:2.0:1782241124.678280:0:8738:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1782241124.679348:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:8737:x1868815139890304:12345-0@lo:502: Request processed in 7047us (7521us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241124.679359:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782241124.679575:0:8737:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8737:1868815139890304:0@lo:502: 00000020:01000000:0.0:1782241124.679617:0:8737:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241124.679624:0:8737:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241124.679627:0:8737:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782241124.679631:0:8737:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1782241124.679924:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1782241124.679947:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1782241124.679959:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e194e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e194e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.679970:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e194e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e194e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241124.679982:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782241124.679985:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e48138000 from 30 10000000:01000000:1.0:1782241124.679988:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782241124.680022:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e1950a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.680031:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e1950a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.680040:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e1950a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241124.680059:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139890688:0@lo:101: 00000100:00100000:1.0:1782241124.680112:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241124.680151:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782241124.680315:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139890688 00000100:00100000:2.0:1782241124.680322:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139890688 00000100:00100000:2.0:1782241124.680368:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782241124.680378:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139890688:12345-0@lo:101: 00010000:00010000:2.0:1782241124.680390:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241124.680403:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e19511 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1950a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.680429:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e19511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1950a expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.680441:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e19511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1950a expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.680450:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860400, rc 0) 00000100:00100000:2.0:1782241124.680516:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139890688:12345-0@lo:101: Request processed in 138us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241124.680522:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1782241124.680619:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139890688:0@lo:101: 00010000:00010000:1.0:1782241124.680633:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e1950a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19511 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.680643:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e1950a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19511 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241124.680711:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139890816:0@lo:501: 00000100:00100000:1.0:1782241124.680739:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241124.680959:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782241124.681043:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139890816 00000100:00100000:0.0:1782241124.681049:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139890816 00000100:00100000:0.0:1782241124.681089:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782241124.681098:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139890816:12345-0@lo:501: 00000100:00100000:0.0:1782241124.681385:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139890816:12345-0@lo:501: Request processed in 287us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241124.681403:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782241124.681441:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139890816:0@lo:501: 00000100:00100000:0.0:1782241124.681473:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139890944:0@lo:503: 00000100:00100000:0.0:1782241124.681516:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241124.681552:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e468103c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241124.682023:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139890944 00000100:00100000:2.0:1782241124.682029:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139890944 00000100:00100000:2.0:1782241124.682060:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782241124.682087:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139890944:12345-0@lo:503: 00000100:00100000:2.0:1782241124.682196:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139890944:12345-0@lo:503: Request processed in 109us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241124.682205:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782241124.682433:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139890944:0@lo:503: 00000100:00100000:0.0:1782241124.683037:0:8740:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8740:1868815139891072:0@lo:502: 00000100:00100000:0.0:1782241124.683094:0:8740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241124.683138:0:8740:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810540 going to sleep for 11 seconds 00000100:00100000:2.0:1782241124.683235:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139891072 00000100:00100000:2.0:1782241124.683673:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139891072 00000100:00100000:2.0:1782241124.684166:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782241124.684176:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+18:8740:x1868815139891072:12345-0@lo:502: 00000100:00100000:2.0:1782241124.684460:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+18:8740:x1868815139891072:12345-0@lo:502: Request processed in 283us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241124.684469:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000004:00080000:0.0:1782241124.686490:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1782241124.686561:0:8740:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8740:1868815139891072:0@lo:502: 00000100:00100000:0.0:1782241124.686794:0:8740:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8740:1868815139891200:0@lo:502: 00000100:00100000:0.0:1782241124.686862:0:8740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241124.687090:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139891200 00000100:00100000:0.0:1782241124.687097:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139891200 00000100:00100000:0.0:1782241124.687275:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782241124.687617:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:8740:x1868815139891200:12345-0@lo:502: 00000100:00100000:0.0:1782241124.687754:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:8740:x1868815139891200:12345-0@lo:502: Request processed in 470us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241124.687829:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782241124.688016:0:8740:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810540 going to sleep for 11 seconds 00000100:00100000:0.0:1782241124.688037:0:8740:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8740:1868815139891200:0@lo:502: 00000040:00080000:0.0:1782241124.688064:0:8740:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 40000000:02000000:0.0:1782241124.689025:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000020:01000000:2.0:1782241124.690063:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1782241124.690102:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782241124.690113:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e1950a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19511 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.690124:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e1950a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19511 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241124.690134:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782241124.690137:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890e48138000 from 5 10000000:01000000:2.0:1782241124.690139:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782241124.690191:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e19518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.690199:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e19518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.690209:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e19518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241124.690239:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4684d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139891328:0@lo:101: 00000100:00100000:2.0:1782241124.690309:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241124.690377:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4776e480 going to sleep for 11 seconds 00000100:00100000:1.0:1782241124.690673:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139891328 00000100:00100000:1.0:1782241124.690680:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139891328 00000100:00100000:1.0:1782241124.690721:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782241124.690729:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139891328:12345-0@lo:101: 00010000:00010000:1.0:1782241124.690743:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241124.690772:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1951f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19518 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.690795:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1951f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19518 expref: 19 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.690804:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1951f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19518 expref: 19 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.690813:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d200, rc 0) 00000100:00100000:1.0:1782241124.690857:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+19:6508:x1868815139891328:12345-0@lo:101: Request processed in 127us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241124.690863:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782241124.690907:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4684d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139891328:0@lo:101: 00010000:00010000:1.0:1782241124.690921:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e19518 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1951f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.690930:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e19518 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1951f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241124.690985:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139891456:0@lo:256: 00000100:00100000:1.0:1782241124.691014:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241124.691028:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863000 going to sleep for 11 seconds 00000100:00100000:2.0:1782241124.691685:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139891456 00000100:00100000:2.0:1782241124.691691:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139891456 00000100:00100000:2.0:1782241124.691731:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782241124.691739:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+19:6508:x1868815139891456:12345-0@lo:256: 20000000:01000000:2.0:1782241124.691778:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782241124.691796:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782241124.691800:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1782241124.691913:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+19:6508:x1868815139891456:12345-0@lo:256: Request processed in 174us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241124.691921:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782241124.692011:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139891456:0@lo:256: 10000000:01000000:1.0:1782241124.692055:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782241124.692063:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e19518 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1951f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.692083:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e19518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1951f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241124.692090:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1782241124.692092:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1782241124.692095:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782241124.692116:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e19526 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.692124:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e19526 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.692132:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e19526 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241124.692146:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139891584:0@lo:101: 00000100:00100000:1.0:1782241124.692174:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241124.692204:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863000 going to sleep for 11 seconds 00000100:00100000:2.0:1782241124.692347:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139891584 00000100:00100000:2.0:1782241124.692352:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139891584 00000100:00100000:2.0:1782241124.692382:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1782241124.692389:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+19:6508:x1868815139891584:12345-0@lo:101: 00010000:00010000:2.0:1782241124.692397:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241124.692407:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b861a00/0xc9959f2fb1e1952d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19526 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.692425:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b861a00/0xc9959f2fb1e1952d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19526 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.692434:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b861a00/0xc9959f2fb1e1952d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19526 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.692443:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861a00, rc 0) 00000100:00100000:2.0:1782241124.692484:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139891584:12345-0@lo:101: Request processed in 96us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241124.692489:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782241124.692563:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139891584:0@lo:101: 00010000:00010000:1.0:1782241124.692648:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e19526 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1952d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.692657:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e19526 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1952d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241124.692723:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139891712:0@lo:501: 00000100:00100000:1.0:1782241124.692749:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241124.692790:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863000 going to sleep for 11 seconds 00000100:00100000:2.0:1782241124.692846:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139891712 00000100:00100000:2.0:1782241124.692850:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139891712 00000100:00100000:2.0:1782241124.692878:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1782241124.692885:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139891712:12345-0@lo:501: 00000100:00100000:2.0:1782241124.692999:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139891712:12345-0@lo:501: Request processed in 114us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241124.693006:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1782241124.694382:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139891712:0@lo:501: 00000100:00100000:1.0:1782241124.694428:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139891840:0@lo:503: 00000100:00100000:1.0:1782241124.694481:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241124.694511:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863000 going to sleep for 11 seconds 00000100:00100000:1.0:1782241124.694526:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139891840 00000100:00100000:1.0:1782241124.694531:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139891840 00000100:00100000:1.0:1782241124.694563:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1782241124.694570:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139891840:12345-0@lo:503: 00000100:00100000:1.0:1782241124.694734:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139891840:12345-0@lo:503: Request processed in 163us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241124.694742:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1782241124.694806:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139891840:0@lo:503: 00000100:00100000:1.0:1782241124.694973:0:8741:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8741:1868815139891968:0@lo:502: 00000100:00100000:1.0:1782241124.695005:0:8741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241124.695023:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139891968 00000100:00100000:1.0:1782241124.695026:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139891968 00000100:00100000:1.0:1782241124.695045:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1782241124.695058:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+20:8741:x1868815139891968:12345-0@lo:502: 00000100:00100000:1.0:1782241124.695148:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+20:8741:x1868815139891968:12345-0@lo:502: Request processed in 90us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241124.695155:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1782241124.695189:0:8741:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241124.695200:0:8741:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8741:1868815139891968:0@lo:502: 00000020:01000000:1.0:1782241124.695220:0:8741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782241124.695228:0:8741:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1782241124.695235:0:8741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241124.695238:0:8741:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1782241124.696686:0:8741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782241124.696696:0:8741:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:01000000:1.0:1782241124.696725:0:8741:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782241124.696728:0:8741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782241124.696770:0:8741:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff890d4691b380) 00000020:00000080:1.0:1782241124.696797:0:8741:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1782241124.696804:0:8741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782241124.696910:0:8741:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1782241124.696917:0:8741:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1782241124.696923:0:8741:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1953b 00010000:00080000:1.0:1782241124.696953:0:8741:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d46926800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241124.697199:0:8741:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:0.0:1782241124.700529:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8432:x1868815139890560:12345-0@lo:700: Request processed in 22424us (22546us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241124.700544:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782241124.700615:0:8432:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7c7e6680 x1868815139890560/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782241140 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241124.700630:0:8432:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8432:1868815139890560:0@lo:700: 40000000:02000000:0.0:1782241124.700643:0:8432:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000001:00100000:3.0:1782241124.710647:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1782241124.710985:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8739:x1868815139890432:12345-0@lo:700: Request processed in 33084us (33787us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241124.711000:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:2.0:1782241124.711344:0:8741:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1782241124.711361:0:8741:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782241124.711583:0:8741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782241124.711831:0:8741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782241124.711922:0:8741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1782241124.712026:0:8741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00010000:00080000:3.0:1782241124.712470:0:8739:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7c7e5880 x1868815139890432/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782241140 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241124.712487:0:8739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8739:1868815139890432:0@lo:700: 00000040:00080000:2.0:1782241124.716704:0:8744:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782241124.716711:0:8744:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1782241124.720609:0:8741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782241124.720624:0:8741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782241124.720669:0:8741:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1782241124.720693:0:8741:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e19542 00000100:00080000:0.0:1782241124.720704:0:8741:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782241124.720711:0:8741:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff890d46926800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241124.720749:0:8741:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a4aa00 x1868815139892096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241124.720803:0:8741:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1782241124.720879:0:8741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241124.720884:0:8741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241124.720886:0:8741:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1782241124.720888:0:8741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782241124.720893:0:8741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241124.720894:0:8741:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782241124.720896:0:8741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782241124.720898:0:8741:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782241124.720927:0:8741:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8741:1868815139892224:0@lo:502: 00000100:00100000:0.0:1782241124.721006:0:8741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1782241124.721030:0:8739:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1782241124.721049:0:8739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8739:1868815139892480:0@lo:7: 00000100:00100000:0.0:1782241124.721079:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139892224 00000100:00100000:0.0:1782241124.721086:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139892224 00000100:00100000:0.0:1782241124.721144:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1782241124.721172:0:8739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241124.721212:0:8739:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77983900 going to sleep for 11 seconds 00000100:00100000:3.0:1782241124.721234:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139892352:0@lo:13: 00000100:00100000:3.0:1782241124.721261:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241124.721292:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139892352 00000100:00100000:1.0:1782241124.721298:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139892352 00000100:00100000:3.0:1782241124.721310:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139892480 00000100:00100000:3.0:1782241124.721315:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139892480 00000100:00100000:1.0:1782241124.721334:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241124.721343:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1868815139892352:12345-0@lo:13: 00000100:00100000:3.0:1782241124.721350:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782241124.721360:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8739:x1868815139892480:12345-0@lo:7: 00002000:00000024:1.0:1782241124.721374:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1782241124.721404:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815139892096:0@lo:8: 00000100:00100000:1.0:1782241124.721432:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1868815139892352:12345-0@lo:13: Request processed in 88us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241124.721450:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241124.721450:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241124.721479:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1782241124.721487:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1782241124.721523:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1782241124.721531:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139892096 00000100:00100000:2.0:1782241124.721535:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139892096 00000100:00100000:0.0:1782241124.721616:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+20:8741:x1868815139892224:12345-0@lo:502: 00000100:00100000:0.0:1782241124.721718:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+20:8741:x1868815139892224:12345-0@lo:502: Request processed in 564us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241124.721726:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:1.0:1782241124.721733:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676d880 x1868815139892352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241124.721753:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139892352:0@lo:13: 00000100:00100000:0.0:1782241124.721840:0:8741:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810540 going to sleep for 11 seconds 00000100:00100000:0.0:1782241124.721853:0:8741:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:8741:1868815139892224:0@lo:502: 00000020:01000000:0.0:1782241124.721877:0:8741:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241124.721882:0:8741:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241124.721884:0:8741:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782241124.721888:0:8741:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1782241124.722001:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782241124.722006:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1868815139892096:12345-0@lo:8: 00010000:00080000:2.0:1782241124.722026:0:8746:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:2.0:1782241124.722057:0:8746:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e19549 00002000:00100000:2.0:1782241124.722078:0:8746:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff890d45a63000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1782241124.722082:0:8746:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1782241124.722085:0:8746:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1782241124.722132:0:8746:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782241124.722218:0:8746:0:(import.c:65:import_set_state_nolock()) ffff890d45a60000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241124.722330:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1868815139892096:12345-0@lo:8: Request processed in 322us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241124.722337:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782241124.722364:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d45a4aa00 x1868815139892096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782241134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241124.722373:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782241124.722390:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1782241124.722397:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782241124.722401:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1782241124.722404:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d46926800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782241124.722416:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782241124.722421:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815139892096:0@lo:8: 00000004:00080000:2.0:1782241124.722443:0:8744:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1782241124.722484:0:8744:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 187980726637ns, next at 0ns, rc = 0 00080000:00080000:2.0:1782241124.722490:0:8744:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1782241124.724235:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:01000000:1.0:1782241124.724341:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1782241124.724377:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782241124.724388:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e19526 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1952d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.724401:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e19526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1952d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241124.724411:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1782241124.724414:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff890e43633380 from 1 10000000:01000000:1.0:1782241124.724417:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:0.0:1782241124.724432:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139892608:0@lo:13: 00010000:00010000:1.0:1782241124.724447:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e19550 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.724457:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e19550 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241124.724468:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e19550 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241124.724484:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139892736:0@lo:101: 00000100:00100000:0.0:1782241124.724496:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241124.725791:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1782241124.725865:0:8745:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1782241124.725892:0:8745:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8745:1868815139892864:0@lo:7: 00000100:00100000:1.0:1782241124.725896:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241124.725919:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139892608 00000100:00100000:1.0:1782241124.725927:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139892608 00000100:00100000:0.0:1782241124.725930:0:8745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241124.725973:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139892864 00000100:00100000:0.0:1782241124.725977:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139892864 00000100:00100000:1.0:1782241124.725991:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241124.726006:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1868815139892608:12345-0@lo:13: 00000100:00100000:0.0:1782241124.726010:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782241124.726021:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8745:x1868815139892864:12345-0@lo:7: 00002000:00000024:1.0:1782241124.726032:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1782241124.726092:0:8745:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810540 going to sleep for 11 seconds 00000100:00100000:1.0:1782241124.726095:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1868815139892608:12345-0@lo:13: Request processed in 93us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241124.726104:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1782241124.726128:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782241124.726170:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d45a49f80 x1868815139892608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241124.726187:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139892608:0@lo:13: 00000100:00100000:2.0:1782241124.729063:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139892736 00000100:00100000:2.0:1782241124.729085:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139892736 00000100:00100000:2.0:1782241124.729143:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1782241124.729153:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139892736:12345-0@lo:101: 00010000:00010000:2.0:1782241124.729168:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241124.729185:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e19557 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19550 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.729221:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e19557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19550 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.729234:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e19557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19550 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.729557:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860200, rc 0) 00000100:00100000:2.0:1782241124.729722:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139892736:12345-0@lo:101: Request processed in 570us (3941us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241124.729730:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1782241124.729815:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139892736:0@lo:101: 00010000:00010000:0.0:1782241124.729834:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e19550 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19557 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241124.729845:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e19550 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19557 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241124.729929:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139892992:0@lo:501: 00000100:00100000:0.0:1782241124.729966:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241124.730015:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e468106c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241124.730031:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139892992 00000100:00100000:0.0:1782241124.730036:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139892992 00000100:00100000:0.0:1782241124.730062:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1782241124.730080:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139892992:12345-0@lo:501: 00000100:00100000:0.0:1782241124.730233:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139892992:12345-0@lo:501: Request processed in 162us (266us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782241124.730241:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1782241124.730338:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139892992:0@lo:501: 10000000:01000000:2.0:1782241124.730369:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782241124.730377:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e19550 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19557 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241124.730386:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e19550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19557 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1782241124.736414:0:8426:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1782241124.736423:0:8426:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1782241124.736522:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8739:x1868815139892480:12345-0@lo:7: Request processed in 15159us (15419us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241124.736542:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782241124.738544:0:8739:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676d500 x1868815139892480/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782241140 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241124.738563:0:8739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8739:1868815139892480:0@lo:7: 00000004:00080000:0.0:1782241124.738578:0:8739:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1782241124.738618:0:8739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8739:1868815139893120:0@lo:5: 00000100:00100000:0.0:1782241124.738670:0:8739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241124.738734:0:8739:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e468109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241124.742269:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139893120 00000100:00100000:0.0:1782241124.742281:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139893120 00002000:00080000:2.0:1782241124.742328:0:8423:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1782241124.742336:0:8423:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1782241124.742346:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782241124.742358:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8739:x1868815139893120:12345-0@lo:5: 00002000:00080000:0.0:1782241124.742390:0:8746:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00010000:00080000:3.0:1782241124.742858:0:8745:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d45a49c00 x1868815139892864/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782241140 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241124.742877:0:8745:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8745:1868815139892864:0@lo:7: 00000004:00080000:3.0:1782241124.742891:0:8745:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1782241124.742931:0:8745:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8745:1868815139893248:0@lo:5: 00000100:00100000:0.0:1782241124.745809:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8739:x1868815139893120:12345-0@lo:5: Request processed in 3443us (7127us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241124.745825:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1782241124.745910:0:8739:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d45a4a680 x1868815139893120/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782241140 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241124.745925:0:8739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8739:1868815139893120:0@lo:5: 00000004:00080000:0.0:1782241124.745940:0:8739:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1782241124.745986:0:8739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8739:1868815139893376:0@lo:5: 00000100:00100000:0.0:1782241124.746035:0:8739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241124.746084:0:8739:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e468109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241124.746101:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139893376 00000100:00100000:0.0:1782241124.746106:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139893376 00000100:00100000:2.0:1782241124.746591:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8745:x1868815139892864:12345-0@lo:7: Request processed in 20557us (20648us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241124.746740:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782241124.746753:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8739:x1868815139893376:12345-0@lo:5: 00002000:00080000:0.0:1782241124.746815:0:8425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1782241124.749468:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8739:x1868815139893376:12345-0@lo:5: Request processed in 2712us (3426us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1782241124.749855:0:8745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241124.749886:0:8745:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77983900 going to sleep for 11 seconds 00000100:00100000:3.0:1782241124.749901:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1782241124.749909:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1782241124.750036:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782241124.750079:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139893248 00000100:00100000:0.0:1782241124.750083:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782241124.750088:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139893248 00000100:00100000:2.0:1782241124.750128:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782241124.750138:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8745:x1868815139893248:12345-0@lo:5: 00002000:00080000:2.0:1782241124.750173:0:8423:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1782241124.750176:0:8423:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:0.0:1782241124.750437:0:8739:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d45a4a680 x1868815139893376/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782241140 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241124.750456:0:8739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8739:1868815139893376:0@lo:5: 00000004:00080000:0.0:1782241124.750469:0:8739:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1782241124.750508:0:8739:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8739:1868815139893504:0@lo:900: 00000100:00100000:0.0:1782241124.750546:0:8739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241124.750578:0:8739:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e468109c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241124.750839:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139893504 00000100:00100000:1.0:1782241124.750844:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139893504 00000100:00100000:1.0:1782241124.750874:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241124.750880:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8739:x1868815139893504:12345-0@lo:900: 00000100:00100000:1.0:1782241124.750921:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8739:x1868815139893504:12345-0@lo:900: Request processed in 41us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241124.750928:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782241124.751403:0:8739:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d45a49c00 x1868815139893504/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782241140 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241124.751416:0:8739:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8739:1868815139893504:0@lo:900: 00000001:00080000:3.0:1782241124.760738:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1782241124.760792:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1782241124.760809:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1782241124.761479:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8745:x1868815139893248:12345-0@lo:5: Request processed in 11331us (11613us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1782241124.761495:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1782241124.761533:0:8745:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676c700 x1868815139893248/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782241140 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241124.761550:0:8745:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1782241124.761560:0:8745:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8745:1868815139893248:0@lo:5: 00000004:00080000:3.0:1782241124.761578:0:8745:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1782241124.761647:0:8745:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8745:1868815139893632:0@lo:700: 00000100:00100000:3.0:1782241124.761711:0:8745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241124.761792:0:8745:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77983900 going to sleep for 11 seconds 00000100:00100000:0.0:1782241124.762719:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139893632 00000100:00100000:0.0:1782241124.762732:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139893632 00000100:00100000:0.0:1782241124.762827:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782241124.762838:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8745:x1868815139893632:12345-0@lo:700: 00000100:00100000:2.0:1782241124.787993:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8745:x1868815139893632:12345-0@lo:700: Request processed in 25147us (26272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241124.788007:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782241124.788101:0:8745:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676c700 x1868815139893632/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782241140 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241124.788116:0:8745:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8745:1868815139893632:0@lo:700: 00000004:02000040:3.0:1782241124.789863:0:8745:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1782241124.795381:0:8745:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8745:1868815139893760:0@lo:5: 00000100:00100000:3.0:1782241124.795449:0:8745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241124.795509:0:8745:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77983900 going to sleep for 11 seconds 00000100:00100000:2.0:1782241124.795657:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139893760 00000100:00100000:2.0:1782241124.795665:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139893760 00000100:00100000:2.0:1782241124.795731:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782241124.795740:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8745:x1868815139893760:12345-0@lo:5: 00002000:00080000:2.0:1782241124.801049:0:8425:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1782241124.801082:0:8425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1782241124.802530:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8745:x1868815139893760:12345-0@lo:5: Request processed in 6785us (7075us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1782241124.802543:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1782241124.802909:0:8745:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676c700 x1868815139893760/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782241140 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241124.802927:0:8745:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8745:1868815139893760:0@lo:5: 00000004:00080000:3.0:1782241124.802941:0:8745:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1782241125.000563:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782241125.419253:0:8803:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782241126.021655:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782241126.305554:0:8855:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782241126.305720:0:8855:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1782241126.662190:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782241126.662697:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139893888:0@lo:41: 00000100:00100000:1.0:1782241126.662872:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241126.667624:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139893888 00000100:00100000:3.0:1782241126.667641:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139893888 00000100:00100000:3.0:1782241126.667709:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782241126.667720:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139893888:12345-0@lo:41: 00000004:00000024:3.0:1782241126.667779:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1782241126.667870:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139893888:12345-0@lo:41: Request processed in 152us (4998us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241126.667877:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782241126.667931:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139893888:0@lo:41: 00010000:00010000:0.0:1782241127.055012:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782241127.302388:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1782241128.070558:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241128.197372:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139894016:0@lo:41: 00000100:00100000:3.0:1782241128.197483:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241128.200716:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139894016 00000100:00100000:0.0:1782241128.200738:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139894016 00000100:00100000:0.0:1782241128.201210:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782241128.201224:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139894016:12345-0@lo:41: 00000004:00000024:0.0:1782241128.201278:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1782241128.201507:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139894016:12345-0@lo:41: Request processed in 286us (4023us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241128.201516:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782241128.201964:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139894016:0@lo:41: 00010000:00010000:3.0:1782241129.093219:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782241129.233939:0:8957:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782241129.234148:0:8957:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1782241129.733233:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241129.733260:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139894144:0@lo:13: 00000100:00100000:1.0:1782241129.733335:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241129.733573:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139894144 00000100:00100000:1.0:1782241129.733581:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139894144 00000100:00100000:1.0:1782241129.733680:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782241129.733690:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139894144:12345-0@lo:13: 00002000:00000024:1.0:1782241129.733723:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241129.733786:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139894144:12345-0@lo:13: Request processed in 97us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241129.733794:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782241129.733838:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e43f33b80 x1868815139894144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241129.733848:0:3639:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1782241129.733867:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139894144:0@lo:13: 00000100:00100000:1.0:1782241129.734096:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139894528:0@lo:400: 00000100:00100000:1.0:1782241129.734125:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241129.734141:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139895040:0@lo:400: 00000100:00100000:1.0:1782241129.734167:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241129.734184:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782241129.734190:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139894656:0@lo:400: 00000100:00100000:1.0:1782241129.734220:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241129.734239:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139895168:0@lo:400: 00000100:00100000:1.0:1782241129.734260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241129.734286:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139895040 00000100:00100000:1.0:1782241129.734290:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139895040 00000100:00100000:0.0:1782241129.734332:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139894272:0@lo:400: 00000100:00100000:0.0:1782241129.734364:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241129.734435:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139894784:0@lo:400: 00000100:00100000:0.0:1782241129.734458:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241129.734480:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782241129.734485:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139894400:0@lo:400: 00000100:00100000:0.0:1782241129.734515:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241129.734535:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139894912:0@lo:400: 00000100:00100000:0.0:1782241129.734558:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241129.734591:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139894528 00000100:00100000:0.0:1782241129.734595:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139894528 00000100:00100000:0.0:1782241129.734626:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139894784 00000100:00100000:0.0:1782241129.734629:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139894784 00000100:00100000:0.0:1782241129.734644:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782241129.734650:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139894528:12345-0@lo:400: 00000100:00100000:0.0:1782241129.734698:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139894528:12345-0@lo:400: Request processed in 47us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241129.734704:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782241129.734718:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782241129.734723:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139894784:12345-0@lo:400: 00000100:00100000:0.0:1782241129.734777:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139894784:12345-0@lo:400: Request processed in 33us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241129.734784:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782241129.734803:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139894656 00000100:00100000:0.0:1782241129.734806:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139894656 00000100:00100000:0.0:1782241129.734822:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139894400 00000100:00100000:0.0:1782241129.734824:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139894400 00000100:00100000:0.0:1782241129.734833:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139894912 00000100:00100000:0.0:1782241129.734835:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139894912 00000100:00080000:2.0:1782241129.735136:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782241129.735141:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241129.735143:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241129.735158:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139894272 00000100:00100000:2.0:1782241129.735163:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139894272 00000100:00100000:2.0:1782241129.735192:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1782241129.735198:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:3637:x1868815139894272:12345-0@lo:400: 00000100:00100000:2.0:1782241129.735256:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:3637:x1868815139894272:12345-0@lo:400: Request processed in 58us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241129.735261:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1782241129.735642:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782241129.735649:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139894656:12345-0@lo:400: 00000100:00100000:1.0:1782241129.735685:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139894656:12345-0@lo:400: Request processed in 37us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241129.735700:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782241129.735714:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782241129.735720:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139894400:12345-0@lo:400: 00000100:00100000:1.0:1782241129.735748:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139894400:12345-0@lo:400: Request processed in 29us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241129.735776:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782241129.735788:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782241129.735794:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139895040:12345-0@lo:400: 00000100:00100000:1.0:1782241129.735822:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139895040:12345-0@lo:400: Request processed in 29us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241129.735828:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782241129.735855:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139895168 00000100:00100000:1.0:1782241129.735860:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139895168 00000100:00100000:1.0:1782241129.735892:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241129.735898:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139895168:12345-0@lo:400: 00000100:00100000:1.0:1782241129.735928:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139895168:12345-0@lo:400: Request processed in 31us (1667us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241129.735934:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241129.736011:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139895296:0@lo:13: 00000100:00100000:1.0:1782241129.736057:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1782241129.736093:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e43f30e00 x1868815139894400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241129.736106:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139894400:0@lo:400: 00000100:00100000:1.0:1782241129.736116:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139894272:0@lo:400: 00000100:00100000:1.0:1782241129.736137:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139894784:0@lo:400: 00000100:00100000:1.0:1782241129.736180:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139895296 00000100:00100000:1.0:1782241129.736184:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139895296 00000100:00100000:1.0:1782241129.736206:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782241129.736212:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139895296:12345-0@lo:13: 00002000:00000024:1.0:1782241129.736226:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241129.736261:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139895296:12345-0@lo:13: Request processed in 49us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241129.736266:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782241129.736291:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7785b800 x1868815139895296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241129.736299:0:3637:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1782241129.736315:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139895296:0@lo:13: 00010000:00080000:1.0:1782241129.736336:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e43f33800 x1868815139894656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241129.736345:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139894656:0@lo:400: 00010000:00080000:1.0:1782241129.736354:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7c6e7480 x1868815139895168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241129.736361:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139895168:0@lo:400: 00000100:00100000:1.0:1782241129.736371:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139894528:0@lo:400: 00010000:00080000:1.0:1782241129.736381:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7c6e4380 x1868815139895040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241129.736389:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c6e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139895040:0@lo:400: 00000100:00080000:2.0:1782241129.736684:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241129.737700:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782241129.737712:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139894912:12345-0@lo:400: 00000100:00100000:1.0:1782241129.737803:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139894912:12345-0@lo:400: Request processed in 93us (3244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241129.737810:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1782241129.738044:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e43f30700 x1868815139894912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241129.738057:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139894912:0@lo:400: 00000020:00000004:3.0:1782241130.103641:0:9005:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782241130.103656:0:9005:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1782241130.116960:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241131.141686:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241131.782007:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139895424:0@lo:41: 00000100:00100000:0.0:1782241131.782133:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241131.782473:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139895424 00000100:00100000:3.0:1782241131.782483:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139895424 00000100:00100000:3.0:1782241131.782550:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782241131.782561:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139895424:12345-0@lo:41: 00000004:00000024:3.0:1782241131.782609:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1782241131.782669:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139895424:12345-0@lo:41: Request processed in 109us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241131.782676:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782241131.782818:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139895424:0@lo:41: 00010000:00010000:0.0:1782241132.166066:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241133.189181:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241133.317418:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139895552:0@lo:41: 00000100:00100000:2.0:1782241133.317530:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241133.317724:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139895552 00000100:00100000:1.0:1782241133.317735:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139895552 00000100:00100000:1.0:1782241133.318067:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782241133.318079:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139895552:12345-0@lo:41: 00000004:00000024:1.0:1782241133.318127:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1782241133.318278:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139895552:12345-0@lo:41: Request processed in 200us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241133.318286:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782241133.318422:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139895552:0@lo:41: 00010000:00010000:2.0:1782241134.217907:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241134.853795:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241134.853826:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139895680:0@lo:13: 00000100:00100000:0.0:1782241134.853933:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241134.854075:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139895680 00000100:00100000:0.0:1782241134.854085:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139895680 00000100:00100000:0.0:1782241134.854162:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782241134.854174:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139895680:12345-0@lo:13: 00002000:00000024:0.0:1782241134.854213:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241134.854273:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139895680:12345-0@lo:13: Request processed in 100us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241134.854281:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1782241134.854321:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782241134.854360:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d45a48700 x1868815139895680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241134.854382:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139895680:0@lo:13: 00000100:00100000:0.0:1782241134.856229:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139895808:0@lo:13: 00000100:00100000:0.0:1782241134.856311:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241134.856406:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139895808 00000100:00100000:0.0:1782241134.856414:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139895808 00000100:00100000:0.0:1782241134.856471:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782241134.856480:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139895808:12345-0@lo:13: 00002000:00000024:0.0:1782241134.856505:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241134.856561:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139895808:12345-0@lo:13: Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241134.856570:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1782241134.856596:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782241134.856624:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d45a48700 x1868815139895808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241134.856645:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139895808:0@lo:13: 00000100:00100000:3.0:1782241134.857500:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139896192:0@lo:400: 00000100:00100000:3.0:1782241134.857551:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241134.857578:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815139896704:0@lo:400: 00000100:00100000:3.0:1782241134.857620:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241134.857653:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782241134.857654:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139896704 00000100:00100000:3.0:1782241134.857660:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139896064:0@lo:400: 00000100:00100000:1.0:1782241134.857662:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139896704 00000100:00100000:3.0:1782241134.857688:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241134.857707:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815139896576:0@lo:400: 00000100:00100000:1.0:1782241134.857720:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139896064 00000100:00100000:1.0:1782241134.857725:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139896064 00000100:00100000:3.0:1782241134.857730:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241134.857742:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139896576 00000100:00100000:1.0:1782241134.857746:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139896576 00000100:00100000:1.0:1782241134.857797:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782241134.857806:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815139896704:12345-0@lo:400: 00000100:00100000:1.0:1782241134.857867:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815139896704:12345-0@lo:400: Request processed in 62us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241134.857885:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782241134.857909:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782241134.857915:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139896064:12345-0@lo:400: 00000100:00100000:1.0:1782241134.857947:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139896064:12345-0@lo:400: Request processed in 32us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241134.857953:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782241134.857963:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782241134.857968:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815139896576:12345-0@lo:400: 00000100:00100000:1.0:1782241134.858002:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815139896576:12345-0@lo:400: Request processed in 23us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241134.858009:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782241134.858351:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139896192 00000100:00100000:0.0:1782241134.858364:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139896192 00000100:00100000:0.0:1782241134.858399:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782241134.858407:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139896192:12345-0@lo:400: 00000100:00100000:0.0:1782241134.858480:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139896192:12345-0@lo:400: Request processed in 73us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241134.858487:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782241134.858529:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139895936:0@lo:400: 00000100:00100000:0.0:1782241134.858564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241134.858593:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139896448:0@lo:400: 00000100:00100000:0.0:1782241134.858617:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241134.858638:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241134.858644:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139896320:0@lo:400: 00000100:00100000:0.0:1782241134.858666:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241134.858695:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139895936 00000100:00100000:0.0:1782241134.858699:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139895936 00000100:00100000:0.0:1782241134.858729:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1782241134.858736:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+21:3638:x1868815139895936:12345-0@lo:400: 00000100:00100000:0.0:1782241134.858806:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+21:3638:x1868815139895936:12345-0@lo:400: Request processed in 70us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241134.858812:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1782241134.858843:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139896448 00000100:00100000:0.0:1782241134.858847:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139896448 00000100:00100000:0.0:1782241134.858869:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782241134.858888:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139896448:12345-0@lo:400: 00000100:00100000:0.0:1782241134.858923:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139896448:12345-0@lo:400: Request processed in 36us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241134.858931:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1782241134.858964:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241134.858969:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782241134.859001:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139895936:0@lo:400: 00010000:00080000:3.0:1782241134.859014:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676f100 x1868815139896064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241134.859020:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139896448:0@lo:400: 00000100:00100000:3.0:1782241134.859037:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139896064:0@lo:400: 00010000:00080000:3.0:1782241134.859054:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e778dc700 x1868815139896576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241134.859063:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815139896576:0@lo:400: 00000100:00100000:3.0:1782241134.859085:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139896192:0@lo:400: 00010000:00080000:3.0:1782241134.859095:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e778df480 x1868815139896704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241134.859104:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815139896704:0@lo:400: 00000100:00100000:0.0:1782241134.859232:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139896320 00000100:00100000:0.0:1782241134.859237:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139896320 00000100:00100000:0.0:1782241134.859268:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782241134.859275:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139896320:12345-0@lo:400: 00000100:00100000:0.0:1782241134.859379:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139896320:12345-0@lo:400: Request processed in 103us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241134.859386:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1782241134.859415:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e778de300 x1868815139896320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241134.859424:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139896320:0@lo:400: 00010000:00010000:0.0:1782241135.237298:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241136.268078:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241136.908470:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139896832:0@lo:41: 00000100:00100000:3.0:1782241136.908543:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241136.908618:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139896832 00000100:00100000:3.0:1782241136.908625:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139896832 00000100:00100000:3.0:1782241136.908669:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782241136.908678:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139896832:12345-0@lo:41: 00000004:00000024:3.0:1782241136.908806:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1782241136.908866:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139896832:12345-0@lo:41: Request processed in 188us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241136.908874:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782241136.908923:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139896832:0@lo:41: 00010000:00010000:0.0:1782241137.286404:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241138.308950:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241138.441285:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241138.441316:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139896960:0@lo:41: 00000100:00100000:2.0:1782241138.441386:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241138.441565:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139896960 00000100:00100000:1.0:1782241138.441574:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139896960 00000100:00100000:1.0:1782241138.441620:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782241138.441629:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139896960:12345-0@lo:41: 00000004:00000024:1.0:1782241138.441670:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1782241138.441714:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139896960:12345-0@lo:41: Request processed in 86us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241138.441721:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782241138.442058:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139896960:0@lo:41: 00010000:00010000:0.0:1782241139.333237:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782241139.550979:0:9504:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782241139.550983:0:9504:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1782241139.550985:0:9504:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1782241139.551109:0:9504:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff890e77a72800 00000020:01000004:2.0:1782241139.551123:0:9504:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1782241139.551138:0:9504:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1782241139.551150:0:9504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff890e81fc8000) 00000020:00000080:2.0:1782241139.551167:0:9504:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1782241139.610401:0:9504:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1782241139.610462:0:9504:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1782241139.637327:0:9504:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1782241139.637565:0:9504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1782241139.637578:0:9504:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782241139.637588:0:9504:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc9959f2fb1e19565 00000020:01000004:1.0:1782241139.637596:0:9504:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1782241139.637617:0:9504:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.158@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782241139.637621:0:9504:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782241139.637627:0:9504:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1782241139.637655:0:9504:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1782241139.637663:0:9504:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.158@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1782241139.661656:0:9504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.158@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782241139.661906:0:9504:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.158@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1782241139.661910:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782241139.661912:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782241139.661914:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782241139.661915:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782241139.661916:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782241139.661918:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782241139.661920:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782241139.661921:0:9504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782241139.661926:0:9504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782241139.661928:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782241139.661929:0:9504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782241139.661932:0:9504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1782241139.661934:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782241139.661935:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782241139.661936:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782241139.661937:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782241139.661938:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782241139.661939:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782241139.661940:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782241139.661941:0:9504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782241139.661942:0:9504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782241139.661943:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782241139.661944:0:9504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782241139.661970:0:9504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1782241139.661990:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139897088:0@lo:253: 00000100:00100000:0.0:1782241139.662070:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241139.662263:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa300 going to sleep for 11 seconds 00000100:00100000:1.0:1782241139.662308:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139897088 00000100:00100000:1.0:1782241139.662315:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139897088 00000100:00100000:1.0:1782241139.662444:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1782241139.662455:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:9504:x1868815139897088:12345-0@lo:253: 20000000:01000000:1.0:1782241139.662483:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1782241139.662487:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1782241139.662492:0:6505:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1782241139.662495:0:6505:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1782241139.662735:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782241139.662911:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1782241139.662926:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1782241139.662944:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1782241139.662950:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1782241139.662961:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1782241139.662974:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1782241139.663055:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1782241139.663069:0:6505:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.158@tcp 20000000:01000000:1.0:1782241139.663085:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.158@tcp (null) (null) (null) 00000040:00080000:1.0:1782241139.663100:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1782241139.663105:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1782241139.663117:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1782241139.663123:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.158@tcp (null) (null) 00000040:00080000:1.0:1782241139.663134:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1782241139.663140:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1782241139.663151:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1782241139.663165:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1782241139.663233:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1782241139.663243:0:6505:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.158@tcp 20000000:01000000:1.0:1782241139.663244:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.158@tcp (null) (null) (null) 00000040:00080000:1.0:1782241139.663258:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1782241139.663262:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1782241139.663286:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1782241139.663293:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.158@tcp (null) (null) 00000040:00080000:1.0:1782241139.663306:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1782241139.663311:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1782241139.663322:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1782241139.663335:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1782241139.663964:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1782241139.663977:0:6505:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.158@tcp 20000000:01000000:1.0:1782241139.663979:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.158@tcp (null) (null) (null) 00000040:00080000:1.0:1782241139.663995:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1782241139.664001:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1782241139.664014:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1782241139.664019:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.158@tcp (null) (null) 00000040:00080000:1.0:1782241139.664028:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1782241139.664033:0:6505:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1782241139.664044:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1782241139.664058:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1782241139.664232:0:6505:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1782241139.664236:0:6505:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1782241139.664239:0:6505:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1782241139.664283:0:6505:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1782241139.664286:0:6505:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782241139.665066:0:9510:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1782241139.665174:0:9510:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1782241139.665190:0:9510:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1782241139.665403:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1782241139.665424:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1782241139.665439:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1782241139.665463:0:6505:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1782241139.665465:0:6505:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782241139.666231:0:9511:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1782241139.666257:0:9511:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1782241139.666274:0:9511:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1782241139.666447:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1782241139.666464:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1782241139.666477:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1782241139.666486:0:6505:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1782241139.666488:0:6505:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782241139.667066:0:9512:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1782241139.667287:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1782241139.667308:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1782241139.667322:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1782241139.667331:0:6505:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1782241139.667333:0:6505:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782241139.668492:0:9513:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1782241139.668541:0:9513:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1782241139.668555:0:9513:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1782241139.668908:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1782241139.668929:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1782241139.668943:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1782241139.668955:0:6505:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1782241139.668957:0:6505:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782241139.669950:0:9514:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1782241139.669981:0:9514:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1782241139.669997:0:9514:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1782241139.670210:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1782241139.670230:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1782241139.670243:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:1.0:1782241139.670258:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782241139.670277:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e8164c200/0xc9959f2fb1e1956c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.670295:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e19462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1945b expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.670302:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164d600/0xc9959f2fb1e1948c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19485 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.670309:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e194c4 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.670317:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e194e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e194e0 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.670323:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e19511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1950a expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.670329:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4b861a00/0xc9959f2fb1e1952d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19526 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.670345:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e19557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19550 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.670353:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e8164c200/0xc9959f2fb1e1956c lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.670390:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e19557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19550 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.670406:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e19557 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19550 expref: 21 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241139.670420:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77859c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1868815139897216:0@lo:104: 00000100:00100000:1.0:1782241139.670489:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782241139.670543:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4b861a00/0xc9959f2fb1e1952d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19526 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.670552:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e4b861a00/0xc9959f2fb1e1952d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19526 expref: 21 pid: 6505 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241139.670560:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1868815139897344:0@lo:104: 00000100:00100000:1.0:1782241139.670583:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782241139.670617:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e19511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1950a expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.670625:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e19511 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1950a expref: 21 pid: 6503 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241139.670632:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77859500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1868815139897472:0@lo:104: 00000100:00100000:1.0:1782241139.670660:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241139.671294:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139897216 00000100:00100000:3.0:1782241139.671304:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139897216 00000100:00100000:3.0:1782241139.671342:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139897344 00000100:00100000:3.0:1782241139.671345:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139897344 00000100:00100000:3.0:1782241139.671356:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139897472 00000100:00100000:3.0:1782241139.671358:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139897472 00000100:00100000:3.0:1782241139.671371:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782241139.671379:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+5:6505:x1868815139897216:12345-0@lo:104: 00010000:00010000:3.0:1782241139.671391:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e19550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19557 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.671457:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782241139.671464:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+5:6505:x1868815139897216:12345-0@lo:104: Request processed in 86us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241139.671471:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782241139.671490:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782241139.671496:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+4:6505:x1868815139897344:12345-0@lo:104: 00010000:00010000:3.0:1782241139.671503:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e19526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1952d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.671534:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782241139.671539:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+4:6505:x1868815139897344:12345-0@lo:104: Request processed in 44us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241139.671544:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782241139.671555:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782241139.671561:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+3:6505:x1868815139897472:12345-0@lo:104: 00010000:00010000:3.0:1782241139.671568:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e1950a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19511 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.671598:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782241139.671602:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+3:6505:x1868815139897472:12345-0@lo:104: Request processed in 43us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241139.671608:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1782241139.671624:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782241139.671629:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e19550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19557 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.671635:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c800 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241139.671645:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e19550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e19557 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.671652:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e19550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e19557 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241139.671658:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e19550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e19557 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241139.671664:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241139.673970:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e19550 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19557 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.673986:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241139.674021:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e19550 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19557 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.674030:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e19550 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19557 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.674047:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241139.674051:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e19526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1952d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.674057:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c400 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241139.674061:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e19526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1952d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.674080:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e19526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1952d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241139.674102:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e19526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1952d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241139.674108:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1782241139.674184:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139897600:0@lo:103: 00000100:00100000:2.0:1782241139.674247:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241139.674352:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139897600 00000100:00100000:2.0:1782241139.674360:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139897600 00010000:00010000:2.0:1782241139.674388:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e19557 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19550 expref: 22 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241139.674417:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782241139.674425:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+22:3639:x1868815139897600:12345-0@lo:103: 00010000:00010000:2.0:1782241139.674438:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241139.674443:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e19557 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19550 expref: 22 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.674455:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e19557 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19550 expref: 22 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.674475:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241139.674512:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+22:3639:x1868815139897600:12345-0@lo:103: Request processed in 88us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.674519:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782241139.674559:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139897600:0@lo:103: 00010000:00010000:1.0:1782241139.674711:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e194e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e194e0 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.674721:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e194e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e194e0 expref: 21 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241139.674732:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1868815139897728:0@lo:104: 00000100:00100000:1.0:1782241139.674796:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782241139.674824:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e194c4 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.674832:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e194c4 expref: 21 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241139.674840:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77859880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1868815139897856:0@lo:104: 00000100:00100000:1.0:1782241139.674861:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241139.674882:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139897728 00000100:00100000:1.0:1782241139.674886:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139897728 00000100:00100000:1.0:1782241139.674908:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139897856 00000100:00100000:1.0:1782241139.674910:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139897856 00000100:00100000:1.0:1782241139.674920:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782241139.674926:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:6505:x1868815139897728:12345-0@lo:104: 00010000:00010000:1.0:1782241139.674935:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e194e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e194e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.674966:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782241139.674971:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:6505:x1868815139897728:12345-0@lo:104: Request processed in 45us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241139.674976:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782241139.674996:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782241139.675001:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:6505:x1868815139897856:12345-0@lo:104: 00010000:00010000:1.0:1782241139.675008:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e194c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e194cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.675032:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782241139.675036:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:6505:x1868815139897856:12345-0@lo:104: Request processed in 35us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241139.675041:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1782241139.675055:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782241139.675060:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e1950a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19511 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.675067:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164de00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241139.675082:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e1950a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e19511 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.675090:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e1950a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e19511 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241139.675096:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e1950a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e19511 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241139.675101:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782241139.675823:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164d600/0xc9959f2fb1e1948c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19485 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241139.675834:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e8164d600/0xc9959f2fb1e1948c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19485 expref: 21 pid: 6505 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241139.675844:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1868815139897984:0@lo:104: 00000100:00100000:0.0:1782241139.675877:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782241139.675928:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e19462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1945b expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241139.675936:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e19462 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1945b expref: 21 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241139.675944:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1868815139898112:0@lo:104: 00000100:00100000:0.0:1782241139.675977:0:6505:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e50885000 going to sleep for 11 seconds 00010000:00010000:0.0:1782241139.675994:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e19557 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19550 expref: 21 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241139.676007:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77859c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1868815139897216:0@lo:104: 00000100:00100000:0.0:1782241139.676018:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1868815139897344:0@lo:104: 00000100:00100000:0.0:1782241139.676026:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77859500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1868815139897472:0@lo:104: 00000100:00100000:0.0:1782241139.676032:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1868815139897728:0@lo:104: 00000100:00100000:0.0:1782241139.676038:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77859880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1868815139897856:0@lo:104: 00010000:00010000:3.0:1782241139.676722:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e19526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1952d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.676733:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241139.676772:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e19526 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1952d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.676790:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164c400/0xc9959f2fb1e19526 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1952d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.676803:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241139.676808:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e194e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e194e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.676814:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40030a00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241139.676817:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e194e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e194e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.676825:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e194e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e194e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241139.676832:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e194e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e194e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241139.676838:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241139.676862:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e194e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e194e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.676867:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241139.676882:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e194e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e194e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.676888:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e194e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e194e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.676898:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241139.676901:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e194c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e194cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.676906:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860a00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241139.676909:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e194c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e194cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.676915:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e194c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e194cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241139.676920:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e194c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e194cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241139.676924:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241139.676934:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e194c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e194cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.676939:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241139.676943:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e194c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e194cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.676958:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e194c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e194cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.676966:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241139.676968:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241139.676970:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241139.676979:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241139.676985:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241139.676997:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139898240:0@lo:103: 00000100:00100000:3.0:1782241139.677034:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241139.677271:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139898368:0@lo:103: 00000100:00100000:3.0:1782241139.677296:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241139.677321:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241139.677327:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139898496:0@lo:103: 00000100:00100000:3.0:1782241139.677350:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241139.677380:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139898240 00000100:00100000:3.0:1782241139.677387:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139898240 00010000:00010000:3.0:1782241139.677410:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4b861a00/0xc9959f2fb1e1952d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19526 expref: 21 pid: 6505 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241139.677431:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139898368 00000100:00100000:3.0:1782241139.677434:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139898368 00010000:00010000:3.0:1782241139.677443:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e194e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e194e0 expref: 22 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241139.677452:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139898496 00000100:00100000:3.0:1782241139.677454:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139898496 00010000:00010000:3.0:1782241139.677462:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e194c4 expref: 23 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241139.677484:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782241139.677493:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+23:3640:x1868815139898240:12345-0@lo:103: 00010000:00010000:3.0:1782241139.677506:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241139.677510:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4b861a00/0xc9959f2fb1e1952d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19526 expref: 23 pid: 6505 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.677521:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4b861a00/0xc9959f2fb1e1952d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19526 expref: 23 pid: 6505 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.677535:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b861a00/0xc9959f2fb1e1952d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19526 expref: 23 pid: 6505 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.677547:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241139.677578:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+22:3640:x1868815139898240:12345-0@lo:103: Request processed in 86us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241139.677586:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782241139.677604:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782241139.677610:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+21:3637:x1868815139898368:12345-0@lo:103: 00010000:00010000:3.0:1782241139.677616:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241139.677620:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e194e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e194e0 expref: 21 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.677628:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e194e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e194e0 expref: 21 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.677638:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e194e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e194e0 expref: 21 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.677656:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241139.677679:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+20:3637:x1868815139898368:12345-0@lo:103: Request processed in 70us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241139.677685:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782241139.677695:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782241139.677700:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e477c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+19:3637:x1868815139898496:12345-0@lo:103: 00010000:00010000:3.0:1782241139.677707:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241139.677711:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e194c4 expref: 19 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.677719:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e194c4 expref: 19 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.677728:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e194cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e194c4 expref: 19 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.677734:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241139.677750:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e477c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+18:3637:x1868815139898496:12345-0@lo:103: Request processed in 50us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241139.677788:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782241139.677845:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139898240:0@lo:103: 00000100:00100000:3.0:1782241139.677864:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139898496:0@lo:103: 00000100:00100000:3.0:1782241139.677870:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139898368:0@lo:103: 00010000:00010000:1.0:1782241139.678011:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e1950a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19511 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.678018:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241139.678035:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e1950a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19511 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.678052:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164de00/0xc9959f2fb1e1950a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19511 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.678061:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241139.678063:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241139.678065:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241139.678091:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782241139.678109:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241139.678143:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139897984 00000100:00100000:1.0:1782241139.678147:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139897984 00000100:00100000:1.0:1782241139.678167:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139898112 00000100:00100000:1.0:1782241139.678169:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139898112 00000100:00100000:1.0:1782241139.678178:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782241139.678183:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46515850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:6505:x1868815139897984:12345-0@lo:104: 00010000:00010000:1.0:1782241139.678191:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e19485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1948c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.678228:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782241139.678233:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46515850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:6505:x1868815139897984:12345-0@lo:104: Request processed in 50us (2356us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241139.678238:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782241139.678264:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782241139.678269:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:6505:x1868815139898112:12345-0@lo:104: 00010000:00010000:1.0:1782241139.678275:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4b861200/0xc9959f2fb1e1945b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19462 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.678302:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782241139.678315:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:6505:x1868815139898112:12345-0@lo:104: Request processed in 45us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241139.678320:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782241139.678352:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1868815139897984:0@lo:104: 00000100:00100000:1.0:1782241139.678361:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1868815139898112:0@lo:104: 00010000:00010000:1.0:1782241139.678394:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e8164c200/0xc9959f2fb1e1956c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.678528:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241139.678534:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e19485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1948c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.678550:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40030200 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241139.678554:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e19485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1948c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.678561:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e19485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1948c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241139.678568:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e19485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1948c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241139.678573:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241139.678598:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e19485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1948c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.678603:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241139.678609:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e19485 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1948c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.678615:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e19485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1948c expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.678624:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241139.678627:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b861200/0xc9959f2fb1e1945b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19462 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.678631:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861200 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241139.678634:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861200/0xc9959f2fb1e1945b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e19462 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.678649:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b861200/0xc9959f2fb1e1945b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e19462 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241139.678655:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861200/0xc9959f2fb1e1945b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e19462 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241139.678659:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241139.678670:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4b861200/0xc9959f2fb1e1945b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19462 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.678675:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241139.678696:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b861200/0xc9959f2fb1e1945b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19462 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.678703:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b861200/0xc9959f2fb1e1945b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19462 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.678715:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241139.678717:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241139.678718:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241139.678724:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782241139.678733:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139898880:0@lo:103: 00000100:00100000:3.0:1782241139.678792:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241139.678816:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139898752:0@lo:103: 00000100:00100000:3.0:1782241139.678834:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241139.678847:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241139.678851:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139898624:0@lo:103: 00000100:00100000:3.0:1782241139.678867:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241139.678898:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139898880 00000100:00100000:3.0:1782241139.678902:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139898880 00010000:00010000:3.0:1782241139.678917:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e19462 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1945b expref: 18 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241139.678929:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139898752 00000100:00100000:3.0:1782241139.678931:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139898752 00010000:00010000:3.0:1782241139.678939:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164d600/0xc9959f2fb1e1948c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19485 expref: 19 pid: 6505 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241139.678947:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139898624 00000100:00100000:3.0:1782241139.678949:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139898624 00010000:00010000:3.0:1782241139.678958:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e19511 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1950a expref: 20 pid: 6503 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241139.678967:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782241139.678972:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62797b42-772f-434f-be35-dfdfcff291e0+20:3638:x1868815139898880:12345-0@lo:103: 00010000:00010000:3.0:1782241139.678979:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241139.678982:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e19462 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1945b expref: 20 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.678991:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e19462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1945b expref: 20 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679001:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e19462 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1945b expref: 20 pid: 6504 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679010:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241139.679036:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62797b42-772f-434f-be35-dfdfcff291e0+19:3638:x1868815139898880:12345-0@lo:103: Request processed in 63us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241139.679041:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782241139.679061:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782241139.679066:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62797b42-772f-434f-be35-dfdfcff291e0+18:3640:x1868815139898752:12345-0@lo:103: 00010000:00010000:3.0:1782241139.679198:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241139.679203:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164d600/0xc9959f2fb1e1948c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19485 expref: 18 pid: 6505 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679211:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164d600/0xc9959f2fb1e1948c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19485 expref: 18 pid: 6505 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679221:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164d600/0xc9959f2fb1e1948c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19485 expref: 18 pid: 6505 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679229:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241139.679298:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62797b42-772f-434f-be35-dfdfcff291e0+17:3640:x1868815139898752:12345-0@lo:103: Request processed in 231us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241139.679304:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782241139.679321:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782241139.679327:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62797b42-772f-434f-be35-dfdfcff291e0+16:3640:x1868815139898624:12345-0@lo:103: 00010000:00010000:3.0:1782241139.679335:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241139.679338:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e19511 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1950a expref: 16 pid: 6503 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679347:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e19511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1950a expref: 16 pid: 6503 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679357:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e19511 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1950a expref: 16 pid: 6503 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679367:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e8164c200/0xc9959f2fb1e1956c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679385:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164c200/0xc9959f2fb1e1956c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679400:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e8164c200/0xc9959f2fb1e1956c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679407:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e8164c200/0xc9959f2fb1e1956c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679414:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e8164c200/0xc9959f2fb1e1956c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679420:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e8164c200/0xc9959f2fb1e1956c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679425:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241139.679429:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e8164c200/0xc9959f2fb1e1956c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679437:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e8164c200/0xc9959f2fb1e1956c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679448:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e8164c200/0xc9959f2fb1e1956c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.679457:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241139.679480:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62797b42-772f-434f-be35-dfdfcff291e0+15:3640:x1868815139898624:12345-0@lo:103: Request processed in 152us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241139.679492:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782241139.679519:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139898880:0@lo:103: 00010000:00010000:3.0:1782241139.679549:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241139.679624:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e8164c200/0xc9959f2fb1e1956c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.679632:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e8164c200/0xc9959f2fb1e1956c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.679638:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164c200/0xc9959f2fb1e1956c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782241139.679653:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1782241139.680475:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139898752:0@lo:103: 00000100:00100000:0.0:1782241139.680494:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139898624:0@lo:103: 00000100:00100000:2.0:1782241139.690241:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+14:9504:x1868815139897088:12345-0@lo:253: Request processed in 27779us (28162us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.690255:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1782241139.691879:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139897088:0@lo:253: 10000000:01000000:0.0:1782241139.691897:0:9504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1782241139.691901:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782241139.691902:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782241139.691904:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782241139.691905:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1782241139.691906:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782241139.691908:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782241139.691910:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782241139.691911:0:9504:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782241139.691913:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782241139.691914:0:9504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782241139.691943:0:9504:0:(tgt_mount.c:101:server_register_mount()) register mount ffff890e77a72800 from lustre-OST0001 10000000:01000000:0.0:1782241139.692177:0:9504:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1782241139.692180:0:9504:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1782241139.692188:0:9504:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff890e43633380 local copy 10000000:01000000:0.0:1782241139.692192:0:9504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782241139.692229:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e19573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241139.692254:0:9504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e19573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241139.692265:0:9504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e19573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241139.692285:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139899008:0@lo:101: 00000100:00100000:0.0:1782241139.692338:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241139.692448:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241139.692601:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139899008 00000100:00100000:2.0:1782241139.692608:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139899008 00000100:00100000:2.0:1782241139.692657:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1782241139.692667:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+14:9504:x1868815139899008:12345-0@lo:101: 00010000:00010000:2.0:1782241139.692680:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241139.692694:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e1957a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19573 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.692730:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e1957a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19573 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.692740:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e1957a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19573 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.692751:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861000, rc 0) 00000100:00100000:2.0:1782241139.692845:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:9504:x1868815139899008:12345-0@lo:101: Request processed in 180us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.692852:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1782241139.692940:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139899008:0@lo:101: 00010000:00010000:1.0:1782241139.692955:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e19573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc9959f2fb1e1957a expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.692977:0:9504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e19573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc9959f2fb1e1957a expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241139.693071:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77859880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139899136:0@lo:501: 00000100:00100000:1.0:1782241139.693099:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241139.693127:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e50885000 going to sleep for 11 seconds 00000100:00100000:2.0:1782241139.693235:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139899136 00000100:00100000:2.0:1782241139.693240:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139899136 00000100:00100000:2.0:1782241139.693275:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1782241139.693282:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:9504:x1868815139899136:12345-0@lo:501: 00000100:00100000:2.0:1782241139.693356:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:9504:x1868815139899136:12345-0@lo:501: Request processed in 74us (255us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782241139.693363:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1782241139.693503:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77859880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139899136:0@lo:501: 10000000:01000000:1.0:1782241139.693523:0:9504:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782241139.693540:0:9504:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782241139.693545:0:9504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e19573 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc9959f2fb1e1957a expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.693553:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e19573 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc9959f2fb1e1957a expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.693559:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e19573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc9959f2fb1e1957a expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.693580:0:9504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782241139.693602:0:9504:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff890e77a72800 10000000:01000000:1.0:1782241139.693607:0:9504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782241139.693611:0:9504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1782241139.693613:0:9504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782241139.693617:0:9504:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1782241139.693619:0:9504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1782241139.693634:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e19581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.693640:0:9504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e19581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.693648:0:9504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e19581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241139.693658:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77859880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139899264:0@lo:101: 00000100:00100000:1.0:1782241139.693682:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241139.693710:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e50885f00 going to sleep for 11 seconds 00010000:00010000:3.0:1782241139.693787:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241139.693794:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e19573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc9959f2fb1e1957a expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.693801:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40031600 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241139.693805:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e19573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc9959f2fb1e1957a expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.693812:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e19573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc9959f2fb1e1957a expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241139.693818:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e19573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc9959f2fb1e1957a expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241139.693823:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241139.693842:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e19573 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc9959f2fb1e1957a expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.693848:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241139.693874:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e19573 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc9959f2fb1e1957a expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.693881:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e19573 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc9959f2fb1e1957a expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.693894:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241139.693895:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241139.693897:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241139.693947:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139899392:0@lo:103: 00000100:00100000:0.0:1782241139.693986:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241139.694131:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139899392 00000100:00100000:3.0:1782241139.694135:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139899392 00000100:00100000:3.0:1782241139.694182:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782241139.694189:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62797b42-772f-434f-be35-dfdfcff291e0+15:3638:x1868815139899392:12345-0@lo:103: 00010000:00010000:3.0:1782241139.694199:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241139.694211:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e1957a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e19573 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.694225:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241139.694255:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62797b42-772f-434f-be35-dfdfcff291e0+14:3638:x1868815139899392:12345-0@lo:103: Request processed in 67us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241139.694261:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782241139.694302:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139899392:0@lo:103: 00000100:00100000:2.0:1782241139.694480:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139899264 00000100:00100000:2.0:1782241139.694484:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139899264 00000100:00100000:2.0:1782241139.694514:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1782241139.694521:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+14:9504:x1868815139899264:12345-0@lo:101: 00010000:00010000:2.0:1782241139.694529:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241139.694540:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b860600/0xc9959f2fb1e19588 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19581 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.694554:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b860600/0xc9959f2fb1e19588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19581 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.694575:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b860600/0xc9959f2fb1e19588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19581 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.694581:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860600, rc 0) 00000100:00100000:2.0:1782241139.694617:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:9504:x1868815139899264:12345-0@lo:101: Request processed in 96us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.694622:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1782241139.694716:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77859880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139899264:0@lo:101: 00010000:00010000:0.0:1782241139.694728:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e19581 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19588 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241139.694735:0:9504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e19581 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19588 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241139.694851:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139899520:0@lo:501: 00000100:00100000:0.0:1782241139.694876:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241139.694907:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa600 going to sleep for 11 seconds 00000100:00100000:2.0:1782241139.695114:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139899520 00000100:00100000:2.0:1782241139.695118:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139899520 00000100:00100000:2.0:1782241139.695150:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1782241139.695157:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b8a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:9504:x1868815139899520:12345-0@lo:501: 00000100:00100000:2.0:1782241139.695255:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b8a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:9504:x1868815139899520:12345-0@lo:501: Request processed in 99us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.695262:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782241139.695366:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139899520:0@lo:501: 00000100:00100000:0.0:1782241139.695393:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139899648:0@lo:503: 00000100:00100000:0.0:1782241139.695434:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241139.695469:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa600 going to sleep for 11 seconds 00000100:00100000:3.0:1782241139.695527:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139899648 00000100:00100000:3.0:1782241139.695532:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139899648 00000100:00100000:3.0:1782241139.695564:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1782241139.695571:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b8a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:9504:x1868815139899648:12345-0@lo:503: 00000100:00100000:3.0:1782241139.695659:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b8a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:9504:x1868815139899648:12345-0@lo:503: Request processed in 88us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241139.695666:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782241139.695804:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139899648:0@lo:503: 00000040:00080000:0.0:1782241139.696202:0:9504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782241139.696280:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139899776:0@lo:502: 00000100:00100000:0.0:1782241139.696319:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241139.696409:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa600 going to sleep for 11 seconds 00000100:00100000:1.0:1782241139.698931:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139899776 00000100:00100000:1.0:1782241139.698946:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139899776 00000100:00100000:0.0:1782241139.701224:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782241139.701239:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b8a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:9504:x1868815139899776:12345-0@lo:502: 00000100:00100000:0.0:1782241139.701464:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b8a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:9504:x1868815139899776:12345-0@lo:502: Request processed in 227us (5144us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241139.701472:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1782241139.701566:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139899776:0@lo:502: 00000040:00080000:1.0:1782241139.701815:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1782241139.701843:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1782241139.701854:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1782241139.701864:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1782241139.701874:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1782241139.701884:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1782241139.701914:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139899904:0@lo:502: 00000100:00100000:1.0:1782241139.701953:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241139.702268:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e50885300 going to sleep for 11 seconds 00000100:00100000:3.0:1782241139.702364:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139899904 00000100:00100000:3.0:1782241139.702371:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139899904 00000100:00100000:3.0:1782241139.702400:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1782241139.702407:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:9504:x1868815139899904:12345-0@lo:502: 00000100:00100000:3.0:1782241139.702491:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:9504:x1868815139899904:12345-0@lo:502: Request processed in 84us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241139.702499:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1782241139.702571:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139899904:0@lo:502: 00000040:00080000:1.0:1782241139.702612:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1782241139.702620:0:9504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1782241139.703131:0:9515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782241139.703139:0:9515:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1782241139.703144:0:9515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241139.703146:0:9515:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1782241139.703151:0:9515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782241139.703164:0:9515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff890d469199c0) 00000020:00000080:1.0:1782241139.703186:0:9515:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1782241139.703192:0:9515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782241139.703257:0:9515:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e77a72800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1782241139.703264:0:9515:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782241139.703270:0:9515:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc9959f2fb1e19596 00010000:00010000:1.0:1782241139.711900:0:9515:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1782241139.712289:0:9515:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1782241139.715299:0:9515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1782241139.715635:0:9515:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1782241139.720586:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1782241139.720837:0:9515:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1782241139.726009:0:9515:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1782241139.727246:0:9515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1782241139.727258:0:9515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241139.727264:0:9515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241139.727267:0:9515:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1782241139.727270:0:9515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241139.727275:0:9515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241139.727276:0:9515:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782241139.727280:0:9515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782241139.727281:0:9515:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782241139.727302:0:9515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241139.727304:0:9515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241139.727305:0:9515:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782241139.727309:0:9515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1782241139.729200:0:9504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1782241139.729243:0:9504:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1782241139.729273:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e19581 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19588 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241139.729286:0:9504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e19581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19588 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241139.729295:0:9504:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e77a72800 from 1 10000000:01000000:0.0:1782241139.729298:0:9504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782241139.729337:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e1959d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241139.729346:0:9504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e1959d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241139.729357:0:9504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e1959d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241139.729383:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139900032:0@lo:101: 00000100:00100000:0.0:1782241139.729462:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241139.729537:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241139.730883:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139900032 00000100:00100000:2.0:1782241139.730894:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139900032 00000100:00100000:2.0:1782241139.730949:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1782241139.731083:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:9504:x1868815139900032:12345-0@lo:101: 00010000:00010000:2.0:1782241139.731098:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241139.731114:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b861e00/0xc9959f2fb1e195a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1959d expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.731138:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b861e00/0xc9959f2fb1e195a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1959d expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.731149:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b861e00/0xc9959f2fb1e195a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1959d expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.731171:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861e00, rc 0) 00000100:00100000:2.0:1782241139.731263:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+16:9504:x1868815139900032:12345-0@lo:101: Request processed in 304us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.731269:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1782241139.731356:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139900032:0@lo:101: 00010000:00010000:0.0:1782241139.731374:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e1959d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e195a4 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241139.731383:0:9504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e1959d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e195a4 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241139.731479:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139900160:0@lo:501: 00000100:00100000:0.0:1782241139.731509:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241139.731566:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241139.731619:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139900160 00000100:00100000:2.0:1782241139.731625:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139900160 00000100:00100000:2.0:1782241139.732817:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782241139.732828:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+16:9504:x1868815139900160:12345-0@lo:501: 00000100:00100000:2.0:1782241139.732987:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+16:9504:x1868815139900160:12345-0@lo:501: Request processed in 161us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.732994:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782241139.733261:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139900160:0@lo:501: 00000100:00100000:1.0:1782241139.733305:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139900288:0@lo:503: 00000100:00100000:1.0:1782241139.733348:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241139.733559:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e50885180 going to sleep for 11 seconds 00000100:00100000:0.0:1782241139.733637:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139900288 00000100:00100000:0.0:1782241139.733643:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139900288 00000100:00100000:0.0:1782241139.733673:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1782241139.733679:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:9504:x1868815139900288:12345-0@lo:503: 00000100:00100000:0.0:1782241139.733824:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:9504:x1868815139900288:12345-0@lo:503: Request processed in 144us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241139.733832:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1782241139.734111:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139900288:0@lo:503: 00000040:00080000:1.0:1782241139.734348:0:9504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782241139.734415:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139900416:0@lo:502: 00000100:00100000:1.0:1782241139.734453:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241139.734473:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e50885180 going to sleep for 11 seconds 00000100:00100000:0.0:1782241139.734528:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139900416 00000100:00100000:0.0:1782241139.734534:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139900416 00000100:00100000:0.0:1782241139.734555:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1782241139.734561:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:9504:x1868815139900416:12345-0@lo:502: 00000100:00100000:0.0:1782241139.734660:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:9504:x1868815139900416:12345-0@lo:502: Request processed in 97us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241139.734666:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1782241139.734749:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139900416:0@lo:502: 00000040:00080000:1.0:1782241139.735351:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1782241139.735385:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1782241139.735411:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139900544:0@lo:502: 00000100:00100000:1.0:1782241139.735459:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241139.735492:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e50885180 going to sleep for 11 seconds 00000100:00100000:0.0:1782241139.736062:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139900544 00000100:00100000:0.0:1782241139.736073:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139900544 00000100:00100000:0.0:1782241139.736099:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1782241139.736106:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:9504:x1868815139900544:12345-0@lo:502: 00000100:00100000:0.0:1782241139.736219:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:9504:x1868815139900544:12345-0@lo:502: Request processed in 113us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241139.736227:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1782241139.737445:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139900544:0@lo:502: 00000040:00080000:1.0:1782241139.737519:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1782241139.737531:0:9504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1782241139.738621:0:9519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241139.738631:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241139.738634:0:9519:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782241139.738641:0:9519:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890e77a72800 00000020:00000080:1.0:1782241139.738643:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782241139.738654:0:9519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241139.738657:0:9519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241139.738658:0:9519:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1782241139.738661:0:9519:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1782241139.738877:0:9504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1782241139.738901:0:9504:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782241139.738945:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e1959d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e195a4 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.738964:0:9504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e1959d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e195a4 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241139.739100:0:9504:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782241139.739103:0:9504:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff890e77a72800 10000000:01000000:0.0:1782241139.739107:0:9504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff890e77a72800 10000000:01000000:0.0:1782241139.739110:0:9504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782241139.739116:0:9504:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e77a72800 from 1 10000000:01000000:0.0:1782241139.739119:0:9504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782241139.739151:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e195ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241139.739160:0:9504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e195ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241139.739171:0:9504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e195ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241139.739190:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139900672:0@lo:101: 00000100:00100000:0.0:1782241139.739240:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241139.739336:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aae40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241139.739369:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139900672 00000100:00100000:2.0:1782241139.739374:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139900672 00000100:00100000:2.0:1782241139.739439:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1782241139.739446:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:9504:x1868815139900672:12345-0@lo:101: 00010000:00010000:2.0:1782241139.739458:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241139.739469:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b861400/0xc9959f2fb1e195b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e195ab expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.739503:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b861400/0xc9959f2fb1e195b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e195ab expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.739512:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b861400/0xc9959f2fb1e195b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e195ab expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.739521:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861400, rc 0) 00000100:00100000:2.0:1782241139.739582:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+17:9504:x1868815139900672:12345-0@lo:101: Request processed in 135us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.739588:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782241139.739650:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139900672:0@lo:101: 00010000:00010000:1.0:1782241139.739662:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e195ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e195b2 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.739671:0:9504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e195ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e195b2 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241139.739734:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139900800:0@lo:501: 00000100:00100000:1.0:1782241139.739794:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241139.739896:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e50885900 going to sleep for 11 seconds 00000100:00100000:0.0:1782241139.739949:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139900800 00000100:00100000:0.0:1782241139.739953:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139900800 00000100:00100000:0.0:1782241139.739978:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782241139.739984:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:9504:x1868815139900800:12345-0@lo:501: 00000100:00100000:0.0:1782241139.740083:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:9504:x1868815139900800:12345-0@lo:501: Request processed in 98us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241139.740095:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782241139.740202:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139900800:0@lo:501: 00000100:00100000:1.0:1782241139.740226:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139900928:0@lo:503: 00000100:00100000:1.0:1782241139.740257:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241139.740275:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e50885900 going to sleep for 11 seconds 00000100:00100000:0.0:1782241139.740316:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139900928 00000100:00100000:0.0:1782241139.740320:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139900928 00000100:00100000:0.0:1782241139.740337:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1782241139.740343:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:9504:x1868815139900928:12345-0@lo:503: 00000100:00100000:0.0:1782241139.740424:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:9504:x1868815139900928:12345-0@lo:503: Request processed in 81us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241139.740430:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782241139.740493:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139900928:0@lo:503: 00000040:00080000:1.0:1782241139.740706:0:9504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782241139.740803:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139901056:0@lo:502: 00000100:00100000:1.0:1782241139.740836:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241139.740857:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e50885900 going to sleep for 11 seconds 00000100:00100000:0.0:1782241139.740909:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139901056 00000100:00100000:0.0:1782241139.740913:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139901056 00000100:00100000:0.0:1782241139.740930:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782241139.740935:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:9504:x1868815139901056:12345-0@lo:502: 00000100:00100000:0.0:1782241139.741137:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:9504:x1868815139901056:12345-0@lo:502: Request processed in 200us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241139.741144:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1782241139.741358:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139901056:0@lo:502: 00000040:00080000:1.0:1782241139.741534:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1782241139.741560:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1782241139.741574:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1782241139.741586:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1782241139.741599:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1782241139.741612:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1782241139.741626:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1782241139.741639:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1782241139.741652:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1782241139.741665:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1782241139.741692:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1782241139.741708:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1782241139.741721:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1782241139.741735:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1782241139.741748:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1782241139.741916:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1782241139.741932:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1782241139.741946:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1782241139.742093:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1782241139.742112:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1782241139.742127:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1782241139.742140:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1782241139.742154:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1782241139.742168:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1782241139.742193:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1782241139.742207:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1782241139.742235:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1782241139.742249:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1782241139.742259:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1782241139.742271:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1782241139.742282:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1782241139.742294:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1782241139.742306:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1782241139.742318:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1782241139.742329:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1782241139.742342:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1782241139.742354:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1782241139.742367:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1782241139.742380:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1782241139.742392:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1782241139.742406:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1782241139.742419:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1782241139.742445:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1782241139.742459:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1782241139.742470:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1782241139.742482:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1782241139.742511:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139901184:0@lo:502: 00000100:00100000:1.0:1782241139.742560:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241139.742630:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e50885300 going to sleep for 11 seconds 00000100:00100000:0.0:1782241139.742668:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139901184 00000100:00100000:0.0:1782241139.742673:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139901184 00000100:00100000:0.0:1782241139.742749:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782241139.742788:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:9504:x1868815139901184:12345-0@lo:502: 00000100:00100000:0.0:1782241139.742895:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:9504:x1868815139901184:12345-0@lo:502: Request processed in 138us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241139.742902:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1782241139.743003:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139901184:0@lo:502: 00000040:00080000:1.0:1782241139.743045:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1782241139.743053:0:9504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1782241139.743616:0:9520:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1782241139.743631:0:9520:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff890d4691cd40) 00000020:00000080:1.0:1782241139.743653:0:9520:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1782241139.743859:0:9520:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e77a72800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782241139.743865:0:9520:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e77a72800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782241139.743867:0:9520:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e77a72800 3 00010000:00080000:1.0:1782241139.743897:0:9520:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d47595800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241139.751581:0:9520:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1782241139.751699:0:9520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1782241139.751750:0:9520:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782241139.753342:0:9520:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc9959f2fb1e195c0 00000100:00080000:1.0:1782241139.753358:0:9520:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782241139.753364:0:9520:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff890d47595800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241139.754143:0:9520:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d4676f100 x1868815139901312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241139.754165:0:9520:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782241139.754577:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815139901312:0@lo:38: 00000100:00100000:2.0:1782241139.754644:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241139.754845:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4684f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139901440:0@lo:400: 00000100:00100000:2.0:1782241139.754877:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241139.754899:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4684dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139901952:0@lo:400: 00000100:00100000:2.0:1782241139.754923:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241139.754945:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4684d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139902464:0@lo:400: 00000100:00100000:2.0:1782241139.754980:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241139.755002:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782241139.755007:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4684f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815139901568:0@lo:400: 00000100:00100000:2.0:1782241139.755026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241139.755046:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4684ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815139902080:0@lo:400: 00000100:00100000:2.0:1782241139.755067:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241139.755097:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4684ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139901824:0@lo:400: 00000100:00100000:2.0:1782241139.755120:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241139.755145:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4684e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139902336:0@lo:400: 00000100:00100000:2.0:1782241139.755178:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241139.755202:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782241139.755208:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4684df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139901696:0@lo:400: 00000100:00100000:2.0:1782241139.755228:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241139.755247:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4684f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815139902208:0@lo:400: 00000100:00100000:2.0:1782241139.755269:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241139.755295:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139901440 00000100:00100000:2.0:1782241139.755301:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139901440 00000100:00100000:2.0:1782241139.755344:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1782241139.755353:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:3639:x1868815139901440:12345-0@lo:400: 00000100:00100000:2.0:1782241139.755407:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:3639:x1868815139901440:12345-0@lo:400: Request processed in 55us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.755415:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1782241139.755446:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139901952 00000100:00100000:2.0:1782241139.755450:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139901952 00000100:00100000:2.0:1782241139.755472:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139901696 00000100:00100000:2.0:1782241139.755474:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139901696 00000100:00100000:2.0:1782241139.755488:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782241139.755493:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139901952:12345-0@lo:400: 00000100:00100000:2.0:1782241139.755531:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139901952:12345-0@lo:400: Request processed in 37us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.755536:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782241139.755548:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782241139.755554:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139901696:12345-0@lo:400: 00000100:00100000:2.0:1782241139.755587:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139901696:12345-0@lo:400: Request processed in 34us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.755603:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782241139.755622:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139901312 00000100:00100000:2.0:1782241139.755626:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139901312 00000100:00100000:2.0:1782241139.755637:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139901568 00000100:00100000:2.0:1782241139.755639:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139901568 00000100:00100000:2.0:1782241139.755653:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139902080 00000100:00100000:2.0:1782241139.755655:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139902080 00000100:00100000:2.0:1782241139.755679:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139901824 00000100:00100000:2.0:1782241139.755681:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139901824 00000100:00100000:2.0:1782241139.755690:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139902208 00000100:00100000:2.0:1782241139.755691:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139902208 00000100:00100000:2.0:1782241139.755703:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782241139.755708:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815139901568:12345-0@lo:400: 00000100:00100000:2.0:1782241139.755742:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815139901568:12345-0@lo:400: Request processed in 34us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.755748:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782241139.755794:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782241139.755800:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815139902080:12345-0@lo:400: 00000100:00100000:2.0:1782241139.755832:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815139902080:12345-0@lo:400: Request processed in 32us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.755838:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782241139.755848:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782241139.755853:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139901824:12345-0@lo:400: 00000100:00100000:2.0:1782241139.755893:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139901824:12345-0@lo:400: Request processed in 40us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.755899:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782241139.755912:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782241139.755918:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815139902208:12345-0@lo:400: 00000100:00100000:2.0:1782241139.755961:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815139902208:12345-0@lo:400: Request processed in 43us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.755967:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782241139.755980:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782241139.755984:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815139901312:12345-0@lo:38: 00010000:00080000:2.0:1782241139.756006:0:6510:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:2.0:1782241139.756053:0:6510:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc9959f2fb1e195c7 00000004:00100000:2.0:1782241139.756069:0:6510:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782241139.756101:0:6510:0:(import.c:65:import_set_state_nolock()) ffff890e77a71000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241139.756147:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1868815139901312:12345-0@lo:38: Request processed in 161us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.756154:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782241139.756178:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139902464 00000100:00100000:2.0:1782241139.756182:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139902464 00000100:00100000:2.0:1782241139.756207:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139902336 00000100:00100000:2.0:1782241139.756210:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139902336 00000100:00100000:2.0:1782241139.756228:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241139.756234:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139902464:12345-0@lo:400: 00000100:00100000:2.0:1782241139.756268:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139902464:12345-0@lo:400: Request processed in 34us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.756275:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241139.756285:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782241139.756291:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139902336:12345-0@lo:400: 00000100:00100000:2.0:1782241139.756322:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139902336:12345-0@lo:400: Request processed in 32us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.756327:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1782241139.756349:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782241139.756353:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241139.756355:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782241139.756384:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676f100 x1868815139901312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241139.756395:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782241139.756403:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1782241139.756411:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782241139.756416:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782241139.756419:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d47595800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782241139.756427:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815139901312:0@lo:38: 00000100:00100000:2.0:1782241139.756462:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4684df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139901696:0@lo:400: 00010000:00080000:2.0:1782241139.756472:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4684f100 x1868815139902208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241139.756481:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4684f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815139902208:0@lo:400: 00010000:00080000:2.0:1782241139.756491:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4684ca80 x1868815139901824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241139.756498:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4684ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139901824:0@lo:400: 00010000:00080000:2.0:1782241139.756507:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4684e680 x1868815139902336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241139.756515:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4684e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139902336:0@lo:400: 00010000:00080000:2.0:1782241139.756544:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4684f800 x1868815139901568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241139.756553:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4684f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815139901568:0@lo:400: 00010000:00080000:2.0:1782241139.756573:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4684ed80 x1868815139902080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241139.756580:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4684ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815139902080:0@lo:400: 00000100:00100000:2.0:1782241139.756590:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4684f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139901440:0@lo:400: 00000100:00100000:2.0:1782241139.756600:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4684dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139901952:0@lo:400: 00010000:00080000:2.0:1782241139.756609:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4684d500 x1868815139902464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241139.756617:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4684d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139902464:0@lo:400: 00000020:01000004:3.0:1782241139.757423:0:9520:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1782241139.757452:0:9520:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff890d47703380) 00000020:00000080:3.0:1782241139.757479:0:9520:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1782241139.757655:0:9520:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e77a72800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782241139.757660:0:9520:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e77a72800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782241139.757663:0:9520:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e77a72800 3 00010000:00080000:3.0:1782241139.757690:0:9520:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d46661000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.158@tcp at head 00000100:00100000:0.0:1782241139.759149:0:9522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9522:1868815139902592:0@lo:901: 00000100:00100000:0.0:1782241139.759236:0:9522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241139.759325:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139902592 00000100:00100000:0.0:1782241139.759332:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139902592 00000100:00100000:0.0:1782241139.759391:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782241139.759399:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9522:x1868815139902592:12345-0@lo:901: 00000100:00100000:0.0:1782241139.759496:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9522:x1868815139902592:12345-0@lo:901: Request processed in 97us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241139.759504:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782241139.759530:0:9522:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aae40 going to sleep for 11 seconds 00010000:00080000:0.0:1782241139.759551:0:9522:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d4676f100 x1868815139902592/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782241155 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241139.759564:0:9522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9522:1868815139902592:0@lo:901: 00010000:00010000:3.0:1782241139.760722:0:9520:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1782241139.760854:0:9520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1782241139.760905:0:9520:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782241139.760917:0:9520:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc9959f2fb1e195d5 00000100:00080000:3.0:1782241139.760927:0:9520:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782241139.760933:0:9520:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff890d46661000 using connection 192.168.204.158@tcp/0@lo 00000100:00080000:2.0:1782241139.761104:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782241139.762666:0:9520:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e778de680 x1868815139902720/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782241139.766879:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1868815139902720:0@lo:38: 00000100:00100000:0.0:1782241139.766957:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782241139.767065:0:9520:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1782241139.768043:0:9520:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:2.0:1782241139.768326:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139902720 00000100:00100000:2.0:1782241139.768335:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139902720 00000100:00100000:2.0:1782241139.768380:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782241139.768388:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815139902720:12345-0@lo:38: 00010000:00080000:2.0:1782241139.768415:0:6510:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:2.0:1782241139.768449:0:6510:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc9959f2fb1e195dc 00000004:00100000:2.0:1782241139.768464:0:6510:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782241139.768493:0:6510:0:(import.c:65:import_set_state_nolock()) ffff890e77a70800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241139.768589:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1868815139902720:12345-0@lo:38: Request processed in 200us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241139.768596:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000000:2.0:1782241139.768623:0:9504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1782241139.768652:0:9504:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782241139.768668:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e195ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e195b2 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.768691:0:9504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e195ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e195b2 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782241139.768746:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782241139.768748:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782241139.768750:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241139.768751:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241139.768752:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241139.768801:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241139.768803:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241139.768804:0:9504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782241139.768805:0:9504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782241139.768808:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241139.768809:0:9504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782241139.768813:0:9504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1782241139.768815:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782241139.768817:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782241139.768818:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241139.768819:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241139.768820:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241139.768821:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241139.768822:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241139.768822:0:9504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782241139.768823:0:9504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782241139.768824:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241139.768825:0:9504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782241139.768845:0:9504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782241139.768858:0:9504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139902848:0@lo:253: 00000100:00100000:2.0:1782241139.768892:0:9504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241139.768922:0:9504:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e428e1300 going to sleep for 11 seconds 00010000:00080000:1.0:1782241139.769044:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e778de680 x1868815139902720/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241139.769055:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782241139.769063:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1782241139.769071:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1782241139.769076:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1782241139.769078:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d46661000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782241139.769085:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1868815139902720:0@lo:38: 00000100:00100000:0.0:1782241139.769736:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139902848 00000100:00100000:0.0:1782241139.769743:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139902848 00000100:00100000:0.0:1782241139.770004:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1782241139.770014:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:9504:x1868815139902848:12345-0@lo:253: 20000000:01000000:0.0:1782241139.770040:0:6503:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1782241139.770054:0:6503:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1782241139.775257:0:6503:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782241139.775308:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1782241139.775681:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:9504:x1868815139902848:12345-0@lo:253: Request processed in 5662us (6781us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241139.775694:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 20000000:01000000:2.0:1782241139.775885:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782241139.775891:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782241139.775913:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e195e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.775941:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e40030600/0xc9959f2fb1e194d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e194d2 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.775949:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1951f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19518 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.776026:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e195e3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.776064:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1951f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19518 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.776078:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1951f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19518 expref: 16 pid: 6503 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241139.776093:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476edc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1868815139902976:0@lo:104: 00000100:00100000:2.0:1782241139.776132:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241139.776234:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e40030600/0xc9959f2fb1e194d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e194d2 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.776243:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e40030600/0xc9959f2fb1e194d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e194d2 expref: 16 pid: 6504 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241139.776252:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ef100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1868815139903104:0@lo:104: 00000100:00100000:2.0:1782241139.776275:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241139.776339:0:9504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:62797b42-772f-434f-be35-dfdfcff291e0:9504:1868815139902848:0@lo:253: 10000000:01000000:3.0:1782241139.776353:0:9504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782241139.776356:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782241139.776358:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782241139.776359:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241139.776360:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241139.776361:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241139.776363:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241139.776364:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782241139.776365:0:9504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782241139.776367:0:9504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782241139.776368:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241139.776369:0:9504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782241139.776384:0:9504:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1782241139.780214:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139902976 00000100:00100000:1.0:1782241139.780228:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139902976 00000100:00100000:2.0:1782241139.780255:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e428e1900 going to sleep for 11 seconds 00080000:10000000:3.0:1782241139.781031:0:9504:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1782241139.781370:0:9504:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1782241139.781570:0:9504:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1782241139.781720:0:9504:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00000100:00100000:1.0:1782241139.782149:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139903104 00000100:00100000:1.0:1782241139.782157:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139903104 00000100:00100000:1.0:1782241139.782193:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782241139.782202:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:6526:x1868815139902976:12345-0@lo:104: 00010000:00010000:1.0:1782241139.782221:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e19518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1951f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.782309:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782241139.782322:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:6526:x1868815139902976:12345-0@lo:104: Request processed in 121us (6190us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241139.782329:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782241139.782348:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782241139.782354:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:6526:x1868815139903104:12345-0@lo:104: 00010000:00010000:1.0:1782241139.782362:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e194d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e194d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.782402:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782241139.782407:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:6526:x1868815139903104:12345-0@lo:104: Request processed in 54us (6133us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241139.782412:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1782241139.782433:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782241139.782438:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e19518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1951f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.782446:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860000 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241139.782449:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e19518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1951f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.782456:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e19518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1951f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241139.782462:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e19518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1951f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241139.782468:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782241139.782499:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e19518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1951f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.782513:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241139.782530:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e19518 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1951f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.782536:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e19518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1951f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.782548:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241139.782551:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e194d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e194d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.782556:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d000 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241139.782558:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e194d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e194d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.782564:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e194d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e194d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241139.782569:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e194d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e194d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241139.782574:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782241139.782586:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e194d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e194d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.782590:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241139.782604:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e194d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e194d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.782610:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e194d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e194d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.782629:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241139.782632:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241139.782633:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241139.782647:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139903360:0@lo:103: 00000100:00100000:1.0:1782241139.782683:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782241139.782797:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241139.782807:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139903360 00000100:00100000:3.0:1782241139.782812:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139903360 00010000:00010000:3.0:1782241139.782831:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e40030600/0xc9959f2fb1e194d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e194d2 expref: 17 pid: 6504 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241139.782856:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782241139.782863:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+17:3637:x1868815139903360:12345-0@lo:103: 00010000:00010000:3.0:1782241139.782873:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241139.782877:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e40030600/0xc9959f2fb1e194d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e194d2 expref: 17 pid: 6504 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.782886:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e40030600/0xc9959f2fb1e194d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e194d2 expref: 17 pid: 6504 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241139.782900:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241139.782931:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+17:3637:x1868815139903360:12345-0@lo:103: Request processed in 69us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241139.782937:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782241139.782983:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139903360:0@lo:103: 00080000:10000000:3.0:1782241139.783025:0:9504:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1782241139.783300:0:9504:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:2.0:1782241139.783596:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139903232:0@lo:103: 00000100:00100000:2.0:1782241139.783632:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241139.783725:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476edc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1868815139902976:0@lo:104: 00010000:00010000:2.0:1782241139.783736:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e40030600/0xc9959f2fb1e194d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e194d2 expref: 16 pid: 6504 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241139.783748:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ef100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1868815139903104:0@lo:104: 00010000:00010000:2.0:1782241139.783810:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e195e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241139.784508:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139903232 00000100:00100000:1.0:1782241139.784516:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139903232 00010000:00010000:1.0:1782241139.784546:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1951f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19518 expref: 16 pid: 6503 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241139.784582:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782241139.784590:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62797b42-772f-434f-be35-dfdfcff291e0+16:3640:x1868815139903232:12345-0@lo:103: 00010000:00010000:1.0:1782241139.784601:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241139.784605:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1951f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19518 expref: 16 pid: 6503 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.784615:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1951f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19518 expref: 16 pid: 6503 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.784629:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1951f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19518 expref: 16 pid: 6503 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.784642:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e195e3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.784649:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e195e3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782241139.784664:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008774336s 00010000:00010000:1.0:1782241139.784681:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e195e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.784688:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e195e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.784694:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e195e3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.784700:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e195e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.784705:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241139.784708:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e195e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.784715:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e195e3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.784727:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e195e3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241139.784735:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241139.784804:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62797b42-772f-434f-be35-dfdfcff291e0+15:3640:x1868815139903232:12345-0@lo:103: Request processed in 215us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241139.784811:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782241139.784908:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139903232:0@lo:103: 00010000:00010000:2.0:1782241139.784933:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e195e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.784940:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e195e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241139.784946:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e195e3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1782241139.786230:0:9504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1782241139.801728:0:9504:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1782241139.801738:0:9504:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1782241139.801928:0:9504:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782241139.802035:0:9504:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.158@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782241139.802059:0:9504:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1782241139.802083:0:9504:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1782241139.803753:0:9504:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782241139.804020:0:9504:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1782241139.973096:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139903488:0@lo:13: 00000100:00100000:0.0:1782241139.973412:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139903616:0@lo:13: 00000100:00100000:0.0:1782241139.973471:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241139.973590:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139903616 00000100:00100000:0.0:1782241139.973597:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139903616 00000100:00100000:0.0:1782241139.973642:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782241139.973650:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139903616:12345-0@lo:13: 00002000:00000024:0.0:1782241139.973680:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241139.973737:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139903616:12345-0@lo:13: Request processed in 88us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241139.973744:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1782241139.973820:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d476ef100 x1868815139903616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241139.973838:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139903616:0@lo:13: 00000100:00100000:2.0:1782241139.974839:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241139.975155:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139903488 00000100:00100000:0.0:1782241139.975162:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139903488 00000100:00100000:0.0:1782241139.975207:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241139.975216:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139903488:12345-0@lo:13: 00002000:00000024:0.0:1782241139.975302:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241139.975357:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139903488:12345-0@lo:13: Request processed in 141us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241139.975363:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1782241139.975434:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7c7e5880 x1868815139903488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241139.975452:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139903488:0@lo:13: 00010000:00010000:3.0:1782241140.357393:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782241140.818212:0:9576:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782241140.818686:0:9576:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782241141.387212:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241142.023029:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241142.023056:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139903744:0@lo:41: 00000100:00100000:1.0:1782241142.023134:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241142.023217:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139903744 00000100:00100000:1.0:1782241142.023231:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139903744 00000100:00100000:1.0:1782241142.023285:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782241142.023295:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139903744:12345-0@lo:41: 00000004:00000024:1.0:1782241142.023331:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1782241142.023380:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139903744:12345-0@lo:41: Request processed in 86us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241142.023389:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782241142.023422:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139903744:0@lo:41: 00010000:00010000:1.0:1782241142.405216:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241143.443546:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241143.557870:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241143.557899:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139903872:0@lo:41: 00000100:00100000:0.0:1782241143.557972:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241143.559343:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139903872 00000100:00100000:1.0:1782241143.559355:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139903872 00000100:00100000:1.0:1782241143.559409:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782241143.559419:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139903872:12345-0@lo:41: 00000004:00000024:1.0:1782241143.559455:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1782241143.559519:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139903872:12345-0@lo:41: Request processed in 101us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241143.559526:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782241143.559574:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139903872:0@lo:41: 00010000:00010000:0.0:1782241144.454094:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241145.099315:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241145.099342:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139904000:0@lo:13: 00000100:00100000:2.0:1782241145.099409:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241145.099543:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139904000 00000100:00100000:2.0:1782241145.099550:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139904000 00000100:00100000:2.0:1782241145.099598:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782241145.099606:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139904000:12345-0@lo:13: 00002000:00000024:2.0:1782241145.099637:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241145.099699:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139904000:12345-0@lo:13: Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241145.099708:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782241145.099729:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139904128:0@lo:13: 00000100:00100000:2.0:1782241145.099751:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782241145.099811:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241145.099822:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139904128 00000100:00100000:2.0:1782241145.099826:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139904128 00000100:00100000:2.0:1782241145.099847:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782241145.099853:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139904128:12345-0@lo:13: 00002000:00000024:2.0:1782241145.099864:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241145.099897:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139904128:12345-0@lo:13: Request processed in 43us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241145.099903:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1782241145.099934:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476efb80 x1868815139904000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241145.099951:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139904000:0@lo:13: 00000100:00080000:2.0:1782241145.099971:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782241145.099985:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476ec000 x1868815139904128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241145.099996:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139904128:0@lo:13: 00000100:00100000:2.0:1782241145.100081:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139904256:0@lo:400: 00000100:00100000:2.0:1782241145.100116:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241145.100146:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139904768:0@lo:400: 00000100:00100000:2.0:1782241145.100170:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241145.100202:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815139905280:0@lo:400: 00000100:00100000:2.0:1782241145.100228:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241145.100251:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782241145.100256:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815139904640:0@lo:400: 00000100:00100000:2.0:1782241145.100276:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241145.100295:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815139905152:0@lo:400: 00000100:00100000:2.0:1782241145.100314:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241145.100333:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139904768 00000100:00100000:1.0:1782241145.100339:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139904768 00000100:00100000:2.0:1782241145.100349:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139904384:0@lo:400: 00000100:00100000:1.0:1782241145.100373:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782241145.100377:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241145.100385:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139904768:12345-0@lo:400: 00000100:00100000:2.0:1782241145.100396:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139904896:0@lo:400: 00000100:00100000:2.0:1782241145.100432:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241145.100439:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139904768:12345-0@lo:400: Request processed in 56us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241145.100450:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782241145.100457:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139904512:0@lo:400: 00000100:00100000:2.0:1782241145.100477:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241145.100497:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139905024:0@lo:400: 00000100:00100000:1.0:1782241145.100515:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782241145.100521:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241145.100534:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139904512 00000100:00100000:1.0:1782241145.100538:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139904512 00000100:00100000:2.0:1782241145.100552:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139904256 00000100:00100000:2.0:1782241145.100557:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139904256 00000100:00100000:1.0:1782241145.100558:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782241145.100568:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139904512:12345-0@lo:400: 00000100:00100000:2.0:1782241145.100595:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782241145.100604:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:3640:x1868815139904256:12345-0@lo:400: 00000100:00100000:1.0:1782241145.100620:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139904512:12345-0@lo:400: Request processed in 53us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241145.100628:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782241145.100646:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+15:3640:x1868815139904256:12345-0@lo:400: Request processed in 43us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241145.100661:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782241145.100701:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139905280 00000100:00100000:2.0:1782241145.100705:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139905280 00000100:00100000:2.0:1782241145.100737:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139904640 00000100:00100000:2.0:1782241145.100740:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139904640 00000100:00100000:2.0:1782241145.100750:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139905152 00000100:00100000:2.0:1782241145.100753:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139905152 00000100:00100000:2.0:1782241145.100783:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139904384 00000100:00100000:2.0:1782241145.100785:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139904384 00000100:00100000:2.0:1782241145.100794:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139904896 00000100:00100000:2.0:1782241145.100796:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139904896 00000100:00100000:2.0:1782241145.100806:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139905024 00000100:00100000:2.0:1782241145.100808:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139905024 00000100:00100000:2.0:1782241145.100819:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782241145.100825:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815139905280:12345-0@lo:400: 00000100:00100000:2.0:1782241145.100859:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815139905280:12345-0@lo:400: Request processed in 33us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241145.100865:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782241145.100877:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782241145.100882:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815139904640:12345-0@lo:400: 00000100:00100000:2.0:1782241145.100912:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815139904640:12345-0@lo:400: Request processed in 29us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241145.100917:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782241145.100928:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782241145.100933:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815139905152:12345-0@lo:400: 00000100:00100000:2.0:1782241145.100961:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815139905152:12345-0@lo:400: Request processed in 27us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241145.100966:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782241145.100984:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782241145.100989:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139904384:12345-0@lo:400: 00000100:00100000:2.0:1782241145.101023:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139904384:12345-0@lo:400: Request processed in 34us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241145.101029:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782241145.101039:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782241145.101044:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139904896:12345-0@lo:400: 00000100:00100000:2.0:1782241145.101072:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139904896:12345-0@lo:400: Request processed in 27us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241145.101077:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782241145.101087:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782241145.101093:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139905024:12345-0@lo:400: 00000100:00100000:2.0:1782241145.101120:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139905024:12345-0@lo:400: Request processed in 28us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241145.101126:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1782241145.101160:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476ece00 x1868815139904640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241145.101170:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815139904640:0@lo:400: 00010000:00080000:2.0:1782241145.101180:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476ef100 x1868815139905152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241145.101188:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815139905152:0@lo:400: 00000100:00100000:2.0:1782241145.101196:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139904256:0@lo:400: 00000100:00100000:2.0:1782241145.101204:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139904768:0@lo:400: 00010000:00080000:2.0:1782241145.101212:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476eca80 x1868815139905280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241145.101225:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815139905280:0@lo:400: 00000100:00100000:2.0:1782241145.101266:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139904512:0@lo:400: 00010000:00080000:2.0:1782241145.101275:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476ec700 x1868815139905024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241145.101282:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139905024:0@lo:400: 00010000:00080000:2.0:1782241145.101290:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476efb80 x1868815139904384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241145.101297:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139904384:0@lo:400: 00010000:00080000:2.0:1782241145.101305:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476ec380 x1868815139904896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241145.101313:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139904896:0@lo:400: 00000100:00080000:1.0:1782241145.101472:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782241145.101476:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1782241145.477671:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782241145.639816:0:9866:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782241146.502292:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782241146.552688:0:9918:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782241146.553010:0:9918:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1782241147.142500:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782241147.142648:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139905408:0@lo:41: 00000100:00100000:3.0:1782241147.142710:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241147.142805:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139905408 00000100:00100000:3.0:1782241147.142813:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139905408 00000100:00100000:3.0:1782241147.142859:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782241147.142867:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139905408:12345-0@lo:41: 00000004:00000024:3.0:1782241147.142901:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1782241147.142939:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139905408:12345-0@lo:41: Request processed in 73us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241147.142946:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782241147.142989:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139905408:0@lo:41: 00010000:00010000:0.0:1782241147.525823:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782241148.166929:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782241148.166938:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e7d6df800 from 39 10000000:01000000:2.0:1782241148.166944:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782241148.166994:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e195ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241148.167007:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e195ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241148.167018:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e195ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241148.167062:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4684df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139905536:0@lo:101: 00000100:00100000:2.0:1782241148.167136:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.167234:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d478d8540 going to sleep for 11 seconds 00000100:00100000:0.0:1782241148.167432:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139905536 00000100:00100000:0.0:1782241148.167440:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139905536 00000100:00100000:0.0:1782241148.167501:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1782241148.167510:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+15:6508:x1868815139905536:12345-0@lo:101: 00010000:00010000:0.0:1782241148.167523:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241148.167535:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e40031200/0xc9959f2fb1e195f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e195ea expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241148.167560:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e40031200/0xc9959f2fb1e195f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e195ea expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241148.167570:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e40031200/0xc9959f2fb1e195f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e195ea expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241148.167579:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e40031200, rc 0) 00000100:00100000:0.0:1782241148.167676:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139905536:12345-0@lo:101: Request processed in 167us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241148.167683:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1782241148.167880:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4684df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139905536:0@lo:101: 00010000:00010000:1.0:1782241148.167898:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e195ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e195f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.167908:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e195ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e195f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241148.167968:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139905664:0@lo:501: 00000100:00100000:1.0:1782241148.167997:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.168027:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748000 going to sleep for 11 seconds 00000100:00100000:2.0:1782241148.168075:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139905664 00000100:00100000:2.0:1782241148.168079:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139905664 00000100:00100000:2.0:1782241148.168111:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1782241148.168118:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139905664:12345-0@lo:501: 00000100:00100000:2.0:1782241148.168256:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139905664:12345-0@lo:501: Request processed in 138us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.168264:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1782241148.168397:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139905664:0@lo:501: 00000100:00100000:1.0:1782241148.168444:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139905792:0@lo:503: 00000100:00100000:1.0:1782241148.168481:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.168509:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748000 going to sleep for 11 seconds 00000100:00100000:2.0:1782241148.168653:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139905792 00000100:00100000:2.0:1782241148.169090:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139905792 00000100:00100000:2.0:1782241148.169129:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1782241148.169137:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139905792:12345-0@lo:503: 00000100:00100000:2.0:1782241148.169256:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139905792:12345-0@lo:503: Request processed in 114us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.169268:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782241148.170517:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139905792:0@lo:503: 00000100:00100000:1.0:1782241148.171470:0:9970:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9970:1868815139905920:0@lo:502: 00000100:00100000:1.0:1782241148.171556:0:9970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.171598:0:9970:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241148.171723:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139905920 00000100:00100000:2.0:1782241148.171729:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139905920 00000100:00100000:2.0:1782241148.171801:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1782241148.171811:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:9970:x1868815139905920:12345-0@lo:502: 00000100:00100000:2.0:1782241148.171968:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:9970:x1868815139905920:12345-0@lo:502: Request processed in 157us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.171975:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1782241148.173452:0:9970:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9970:1868815139905920:0@lo:502: 00000100:00100000:1.0:1782241148.173619:0:9970:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9970:1868815139906048:0@lo:502: 00000100:00100000:1.0:1782241148.173682:0:9970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.173727:0:9970:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241148.173802:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139906048 00000100:00100000:0.0:1782241148.173809:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139906048 00000100:00100000:0.0:1782241148.173854:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782241148.173862:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+16:9970:x1868815139906048:12345-0@lo:502: 00000100:00100000:0.0:1782241148.174005:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+16:9970:x1868815139906048:12345-0@lo:502: Request processed in 142us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241148.174012:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1782241148.174195:0:9970:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9970:1868815139906048:0@lo:502: 00000040:00080000:1.0:1782241148.174216:0:9970:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1782241148.174376:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1782241148.174397:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782241148.174414:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e195ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e195f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241148.174424:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e195ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e195f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241148.174433:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1782241148.174436:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1782241148.174439:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782241148.174463:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e195f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241148.174471:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e195f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241148.174479:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e195f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241148.174503:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4684df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139906176:0@lo:101: 00000100:00100000:2.0:1782241148.174532:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.174581:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d478d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1782241148.174694:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139906176 00000100:00100000:0.0:1782241148.174699:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139906176 00000100:00100000:0.0:1782241148.174729:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782241148.174736:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139906176:12345-0@lo:101: 00010000:00010000:0.0:1782241148.174752:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241148.174809:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e195ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e195f8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241148.174832:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e195ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e195f8 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241148.174841:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e195ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e195f8 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241148.174850:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e40030a00, rc 0) 00000100:00100000:0.0:1782241148.174907:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139906176:12345-0@lo:101: Request processed in 171us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241148.174913:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782241148.175026:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4684df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139906176:0@lo:101: 00010000:00010000:3.0:1782241148.175041:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e195f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e195ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241148.175050:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e195f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e195ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241148.175106:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139906304:0@lo:501: 00000100:00100000:3.0:1782241148.175132:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241148.175160:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47bef240 going to sleep for 11 seconds 00000100:00100000:2.0:1782241148.175209:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139906304 00000100:00100000:2.0:1782241148.175214:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139906304 00000100:00100000:2.0:1782241148.175246:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782241148.175253:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139906304:12345-0@lo:501: 00000100:00100000:2.0:1782241148.175385:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139906304:12345-0@lo:501: Request processed in 132us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.175392:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1782241148.175627:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139906304:0@lo:501: 00000100:00100000:3.0:1782241148.175664:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139906432:0@lo:503: 00000100:00100000:3.0:1782241148.175700:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241148.175719:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47bef240 going to sleep for 11 seconds 00000100:00100000:2.0:1782241148.175891:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139906432 00000100:00100000:2.0:1782241148.175896:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139906432 00000100:00100000:2.0:1782241148.175941:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782241148.175948:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139906432:12345-0@lo:503: 00000100:00100000:2.0:1782241148.176044:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139906432:12345-0@lo:503: Request processed in 96us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.176051:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1782241148.176167:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139906432:0@lo:503: 00000100:00100000:0.0:1782241148.176689:0:9971:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9971:1868815139906560:0@lo:502: 00000100:00100000:0.0:1782241148.176730:0:9971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241148.176821:0:9971:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afd480 going to sleep for 11 seconds 00000100:00100000:2.0:1782241148.176958:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139906560 00000100:00100000:2.0:1782241148.176964:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139906560 00000100:00100000:2.0:1782241148.177036:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782241148.177043:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:9971:x1868815139906560:12345-0@lo:502: 00000100:00100000:2.0:1782241148.177144:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:9971:x1868815139906560:12345-0@lo:502: Request processed in 101us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.177152:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782241148.177228:0:9971:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9971:1868815139906560:0@lo:502: 00000020:01000000:3.0:1782241148.177252:0:9971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241148.177262:0:9971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241148.177264:0:9971:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782241148.177269:0:9971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782241148.177270:0:9971:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1782241148.177299:0:9971:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9971:1868815139906688:0@lo:502: 00000100:00100000:3.0:1782241148.177332:0:9971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241148.188507:0:9971:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47bef240 going to sleep for 11 seconds 00000100:00100000:0.0:1782241148.195580:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139906688 00000100:00100000:0.0:1782241148.195598:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139906688 00000100:00100000:0.0:1782241148.195673:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782241148.195684:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+17:9971:x1868815139906688:12345-0@lo:502: 00000100:00100000:0.0:1782241148.195932:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+17:9971:x1868815139906688:12345-0@lo:502: Request processed in 249us (18598us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241148.195940:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782241148.196063:0:9971:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9971:1868815139906688:0@lo:502: 00000020:01000000:3.0:1782241148.196102:0:9971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241148.196109:0:9971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241148.196111:0:9971:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782241148.196116:0:9971:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1782241148.196469:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1782241148.196493:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1782241148.196511:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e195f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e195ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241148.196522:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e195f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e195ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241148.196531:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782241148.196533:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e43609000 from 39 10000000:01000000:0.0:1782241148.196536:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782241148.196568:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40030600/0xc9959f2fb1e19606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241148.196576:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e40030600/0xc9959f2fb1e19606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241148.196584:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e40030600/0xc9959f2fb1e19606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241148.196603:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139906816:0@lo:101: 00000100:00100000:0.0:1782241148.196654:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241148.196706:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afd480 going to sleep for 11 seconds 00000100:00100000:2.0:1782241148.196780:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139906816 00000100:00100000:2.0:1782241148.196786:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139906816 00000100:00100000:2.0:1782241148.196815:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782241148.196822:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139906816:12345-0@lo:101: 00010000:00010000:2.0:1782241148.196832:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241148.196844:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1960d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19606 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241148.196865:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1960d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19606 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241148.196876:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1960d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19606 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241148.196886:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861600, rc 0) 00000100:00100000:2.0:1782241148.196940:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139906816:12345-0@lo:101: Request processed in 118us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.196953:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782241148.197031:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139906816:0@lo:101: 00010000:00010000:0.0:1782241148.197044:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e40030600/0xc9959f2fb1e19606 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1960d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241148.197053:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e40030600/0xc9959f2fb1e19606 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1960d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241148.197098:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139906944:0@lo:501: 00000100:00100000:0.0:1782241148.197134:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241148.197165:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afd480 going to sleep for 11 seconds 00000100:00100000:3.0:1782241148.197230:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139906944 00000100:00100000:3.0:1782241148.197235:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139906944 00000100:00100000:3.0:1782241148.197254:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782241148.197260:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139906944:12345-0@lo:501: 00000100:00100000:3.0:1782241148.197376:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139906944:12345-0@lo:501: Request processed in 116us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241148.197383:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782241148.197507:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139906944:0@lo:501: 00000100:00100000:0.0:1782241148.197531:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139907072:0@lo:503: 00000100:00100000:0.0:1782241148.197565:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241148.197592:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afd480 going to sleep for 11 seconds 00000100:00100000:2.0:1782241148.198909:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139907072 00000100:00100000:2.0:1782241148.198925:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139907072 00000100:00100000:2.0:1782241148.198977:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782241148.198985:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139907072:12345-0@lo:503: 00000100:00100000:2.0:1782241148.199177:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139907072:12345-0@lo:503: Request processed in 188us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.199188:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782241148.200491:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139907072:0@lo:503: 00000100:00100000:2.0:1782241148.200963:0:9972:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4684df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9972:1868815139907200:0@lo:502: 00000100:00100000:2.0:1782241148.201036:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.201115:0:9972:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4c670780 going to sleep for 11 seconds 00000100:00100000:0.0:1782241148.201187:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139907200 00000100:00100000:0.0:1782241148.201192:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139907200 00000100:00100000:0.0:1782241148.201250:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782241148.201263:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+18:9972:x1868815139907200:12345-0@lo:502: 00000100:00100000:0.0:1782241148.201581:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+18:9972:x1868815139907200:12345-0@lo:502: Request processed in 321us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241148.201590:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1782241148.206858:0:9972:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4684df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9972:1868815139907200:0@lo:502: 00000100:00100000:3.0:1782241148.207101:0:9972:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9972:1868815139907328:0@lo:502: 00000100:00100000:3.0:1782241148.207183:0:9972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241148.207229:0:9972:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47bef0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241148.207302:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139907328 00000100:00100000:0.0:1782241148.207310:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139907328 00000100:00100000:0.0:1782241148.207365:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1782241148.207375:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:9972:x1868815139907328:12345-0@lo:502: 00000100:00100000:0.0:1782241148.207533:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:9972:x1868815139907328:12345-0@lo:502: Request processed in 158us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241148.207541:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782241148.207698:0:9972:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9972:1868815139907328:0@lo:502: 00000040:00080000:3.0:1782241148.207719:0:9972:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1782241148.209915:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1782241148.209948:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782241148.209961:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40030600/0xc9959f2fb1e19606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1960d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241148.209992:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e40030600/0xc9959f2fb1e19606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1960d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241148.210004:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782241148.210006:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890e43609000 from 6 10000000:01000000:0.0:1782241148.210009:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782241148.210050:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241148.210058:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241148.210069:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241148.210091:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139907456:0@lo:101: 00000100:00100000:0.0:1782241148.210148:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241148.210219:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afde40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241148.210307:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139907456 00000100:00100000:3.0:1782241148.210315:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139907456 00000100:00100000:3.0:1782241148.210359:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1782241148.210367:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139907456:12345-0@lo:101: 00010000:00010000:3.0:1782241148.210381:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241148.210395:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e47181400/0xc9959f2fb1e1961b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19614 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241148.210416:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e47181400/0xc9959f2fb1e1961b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19614 expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241148.210426:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e47181400/0xc9959f2fb1e1961b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19614 expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241148.210434:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e47181400, rc 0) 00000100:00100000:3.0:1782241148.210490:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+19:6508:x1868815139907456:12345-0@lo:101: Request processed in 123us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241148.210497:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782241148.210647:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139907456:0@lo:101: 00010000:00010000:1.0:1782241148.210662:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1961b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.210671:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1961b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241148.210721:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139907584:0@lo:256: 00000100:00100000:1.0:1782241148.210807:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.210826:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748000 going to sleep for 11 seconds 00000100:00100000:2.0:1782241148.210907:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139907584 00000100:00100000:2.0:1782241148.210912:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139907584 00000100:00100000:2.0:1782241148.210941:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1782241148.210948:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+19:6508:x1868815139907584:12345-0@lo:256: 20000000:01000000:2.0:1782241148.210963:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782241148.210980:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782241148.210983:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1782241148.211099:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+19:6508:x1868815139907584:12345-0@lo:256: Request processed in 151us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.211106:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782241148.211174:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139907584:0@lo:256: 10000000:01000000:1.0:1782241148.211219:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782241148.211226:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1961b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.211233:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1961b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241148.211239:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1782241148.211241:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1782241148.211243:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1782241148.211260:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164da00/0xc9959f2fb1e19622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.211277:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164da00/0xc9959f2fb1e19622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.211295:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164da00/0xc9959f2fb1e19622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241148.211308:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139907712:0@lo:101: 00000100:00100000:1.0:1782241148.211334:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.211355:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748000 going to sleep for 11 seconds 00000100:00100000:2.0:1782241148.211459:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139907712 00000100:00100000:2.0:1782241148.211464:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139907712 00000100:00100000:2.0:1782241148.211483:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1782241148.211489:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+19:6508:x1868815139907712:12345-0@lo:101: 00010000:00010000:2.0:1782241148.211506:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241148.211516:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e19629 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19622 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241148.211532:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e19629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19622 expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241148.211541:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e19629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19622 expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241148.211549:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861200, rc 0) 00000100:00100000:2.0:1782241148.211592:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139907712:12345-0@lo:101: Request processed in 103us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.211598:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782241148.211674:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139907712:0@lo:101: 00010000:00010000:1.0:1782241148.211686:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164da00/0xc9959f2fb1e19622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19629 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.211695:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164da00/0xc9959f2fb1e19622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19629 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241148.211745:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139907840:0@lo:501: 00000100:00100000:1.0:1782241148.211802:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.211818:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748000 going to sleep for 11 seconds 00000100:00100000:2.0:1782241148.211865:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139907840 00000100:00100000:2.0:1782241148.211869:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139907840 00000100:00100000:2.0:1782241148.211886:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1782241148.211892:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e49385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139907840:12345-0@lo:501: 00000100:00100000:2.0:1782241148.212019:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e49385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139907840:12345-0@lo:501: Request processed in 126us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.212026:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1782241148.212087:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139907840:0@lo:501: 00000100:00100000:1.0:1782241148.212112:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139907968:0@lo:503: 00000100:00100000:1.0:1782241148.212148:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.212167:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748000 going to sleep for 11 seconds 00000100:00100000:2.0:1782241148.212211:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139907968 00000100:00100000:2.0:1782241148.212215:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139907968 00000100:00100000:2.0:1782241148.212231:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1782241148.212237:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e438c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139907968:12345-0@lo:503: 00000100:00100000:2.0:1782241148.212332:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e438c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139907968:12345-0@lo:503: Request processed in 94us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.212339:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782241148.212478:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139907968:0@lo:503: 00000100:00100000:0.0:1782241148.213372:0:9973:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9973:1868815139908096:0@lo:502: 00000100:00100000:0.0:1782241148.213428:0:9973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.213586:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139908096 00000100:00100000:2.0:1782241148.213592:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139908096 00000100:00100000:2.0:1782241148.221457:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1782241148.221484:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e438c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+20:9973:x1868815139908096:12345-0@lo:502: 00000100:00100000:2.0:1782241148.221702:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e438c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+20:9973:x1868815139908096:12345-0@lo:502: Request processed in 233us (8273us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.221717:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782241148.221931:0:9973:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afde40 going to sleep for 11 seconds 00000100:00100000:0.0:1782241148.221957:0:9973:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9973:1868815139908096:0@lo:502: 00000020:01000000:0.0:1782241148.221996:0:9973:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782241148.222005:0:9973:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1782241148.222013:0:9973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241148.222015:0:9973:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1782241148.222020:0:9973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782241148.222024:0:9973:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:01000000:0.0:1782241148.222056:0:9973:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1782241148.222060:0:9973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782241148.222074:0:9973:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff890d46743380) 00000020:00000080:0.0:1782241148.222101:0:9973:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1782241148.222107:0:9973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782241148.222209:0:9973:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1782241148.222215:0:9973:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1782241148.222223:0:9973:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e19637 00010000:00080000:0.0:1782241148.222254:0:9973:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d46bb2000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.158@tcp at head 00010000:00010000:0.0:1782241148.222566:0:9973:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1782241148.222704:0:9973:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1782241148.222715:0:9973:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1782241148.223025:0:9973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782241148.223138:0:9973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782241148.223271:0:9973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1782241148.223995:0:9973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1782241148.225465:0:9974:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782241148.225471:0:9974:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1782241148.226244:0:9973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1782241148.226257:0:9973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782241148.226320:0:9973:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1782241148.226351:0:9973:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e1963e 00000100:00080000:3.0:1782241148.226365:0:9973:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782241148.226372:0:9973:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff890d46bb2000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241148.226412:0:9973:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e778dd880 x1868815139908224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782241148.226440:0:9973:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1782241148.226514:0:9973:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241148.226518:0:9973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241148.226520:0:9973:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1782241148.226523:0:9973:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241148.226527:0:9973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241148.226528:0:9973:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782241148.226531:0:9973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782241148.226532:0:9973:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1782241148.226564:0:9973:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9973:1868815139908352:0@lo:502: 00000100:00100000:3.0:1782241148.226663:0:9973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241148.226707:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139908352 00000100:00100000:3.0:1782241148.226714:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139908352 00000100:00100000:3.0:1782241148.226782:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1782241148.226792:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e438c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+20:9973:x1868815139908352:12345-0@lo:502: 00000100:00100000:3.0:1782241148.226917:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e438c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+20:9973:x1868815139908352:12345-0@lo:502: Request processed in 125us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241148.226925:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1782241148.226981:0:9973:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e779823c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241148.227002:0:9973:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9973:1868815139908352:0@lo:502: 00000020:01000000:3.0:1782241148.227027:0:9973:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241148.227032:0:9973:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241148.227033:0:9973:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782241148.227037:0:9973:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:1.0:1782241148.227322:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815139908224:0@lo:8: 00000100:00100000:1.0:1782241148.227372:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.227413:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139908224 00000100:00100000:1.0:1782241148.227416:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139908224 00000100:00100000:1.0:1782241148.227436:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782241148.227440:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1868815139908224:12345-0@lo:8: 00010000:00080000:1.0:1782241148.227463:0:8425:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:1.0:1782241148.227487:0:8425:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e19645 00002000:00100000:1.0:1782241148.227501:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff890d45a40000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1782241148.227505:0:8425:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1782241148.227509:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1782241148.227578:0:8425:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782241148.227847:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1782241148.227875:0:8425:0:(import.c:65:import_set_state_nolock()) ffff890d46922800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241148.227917:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1868815139908224:12345-0@lo:8: Request processed in 475us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.227923:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1782241148.227956:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e778dd880 x1868815139908224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782241158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241148.227965:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782241148.227971:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1782241148.227977:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1782241148.227982:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1782241148.227984:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d46bb2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1782241148.227988:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1782241148.227992:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815139908224:0@lo:8: 00000020:01000000:1.0:1782241148.228011:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1782241148.228039:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1782241148.228048:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164da00/0xc9959f2fb1e19622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19629 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.228057:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164da00/0xc9959f2fb1e19622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19629 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241148.228068:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782241148.228070:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e48138000 from 39 10000000:01000000:1.0:1782241148.228073:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782241148.228102:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1964c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.228110:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1964c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.228120:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1964c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241148.228138:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139908480:0@lo:101: 00000100:00100000:1.0:1782241148.228167:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.228191:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139908480 00000100:00100000:1.0:1782241148.228195:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139908480 00000100:00100000:1.0:1782241148.228220:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782241148.228227:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139908480:12345-0@lo:101: 00010000:00010000:1.0:1782241148.228236:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241148.228249:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e19653 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1964c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.228269:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e19653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1964c expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.228285:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e19653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1964c expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.228293:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c400, rc 0) 00000100:00100000:1.0:1782241148.228324:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139908480:12345-0@lo:101: Request processed in 98us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.228330:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782241148.228361:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748000 going to sleep for 11 seconds 00000100:00100000:1.0:1782241148.228372:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139908480:0@lo:101: 00010000:00010000:1.0:1782241148.228383:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1964c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.228391:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1964c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241148.228435:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139908608:0@lo:501: 00000100:00100000:1.0:1782241148.228458:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.228470:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748000 going to sleep for 11 seconds 00000100:00100000:1.0:1782241148.228481:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139908608 00000100:00100000:1.0:1782241148.228484:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139908608 00000100:00100000:1.0:1782241148.228503:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1782241148.228509:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139908608:12345-0@lo:501: 00000100:00100000:1.0:1782241148.228626:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139908608:12345-0@lo:501: Request processed in 116us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.228632:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1782241148.228662:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139908608:0@lo:501: 00000100:00100000:1.0:1782241148.228693:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139908736:0@lo:503: 00000100:00100000:1.0:1782241148.228726:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.228739:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748000 going to sleep for 11 seconds 00000100:00100000:1.0:1782241148.228751:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139908736 00000100:00100000:1.0:1782241148.228754:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139908736 00000100:00100000:1.0:1782241148.228803:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1782241148.228809:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139908736:12345-0@lo:503: 00000100:00100000:1.0:1782241148.228888:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139908736:12345-0@lo:503: Request processed in 78us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.228894:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1782241148.228932:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139908736:0@lo:503: 00000100:00100000:1.0:1782241148.229208:0:9976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9976:1868815139908864:0@lo:502: 00000100:00100000:1.0:1782241148.229241:0:9976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.229263:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139908864 00000100:00100000:1.0:1782241148.229266:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139908864 00000100:00100000:1.0:1782241148.229521:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1782241148.229530:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:9976:x1868815139908864:12345-0@lo:502: 00000100:00100000:2.0:1782241148.229733:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139909376:0@lo:400: 00000100:00100000:2.0:1782241148.229807:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.229862:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139909888:0@lo:400: 00000100:00100000:2.0:1782241148.229887:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.229920:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782241148.229926:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4684df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139908992:0@lo:400: 00000100:00100000:2.0:1782241148.229952:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.229974:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139909504:0@lo:400: 00000100:00100000:2.0:1782241148.229993:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.230013:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815139910016:0@lo:400: 00000100:00100000:2.0:1782241148.230032:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.230061:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139909120:0@lo:400: 00000100:00100000:2.0:1782241148.230083:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.230109:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139909632:0@lo:400: 00000100:00100000:2.0:1782241148.230129:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.230143:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815139910144:0@lo:400: 00000100:00100000:2.0:1782241148.230162:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.230177:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782241148.230182:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139909248:0@lo:400: 00000100:00100000:2.0:1782241148.230211:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.230228:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139909760:0@lo:400: 00000100:00100000:2.0:1782241148.230248:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.230462:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:9976:x1868815139908864:12345-0@lo:502: Request processed in 932us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.230470:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1782241148.230517:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139909888 00000100:00100000:1.0:1782241148.230522:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139909888 00000100:00100000:1.0:1782241148.230558:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139909760 00000100:00100000:1.0:1782241148.230561:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139909760 00000100:00100000:1.0:1782241148.230583:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782241148.230591:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139909888:12345-0@lo:400: 00000100:00100000:1.0:1782241148.230659:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139909888:12345-0@lo:400: Request processed in 68us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.230667:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782241148.230680:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782241148.230686:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139909760:12345-0@lo:400: 00000100:00100000:1.0:1782241148.230714:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139909760:12345-0@lo:400: Request processed in 29us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.230721:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1782241148.230736:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782241148.230785:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476ee300 x1868815139909760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241148.230799:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139909760:0@lo:400: 00010000:00080000:1.0:1782241148.230830:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476ec000 x1868815139909888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241148.230838:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139909888:0@lo:400: 00000100:00100000:1.0:1782241148.230860:0:9976:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748480 going to sleep for 11 seconds 00000100:00100000:1.0:1782241148.230871:0:9976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9976:1868815139908864:0@lo:502: 00000100:00100000:1.0:1782241148.230920:0:9976:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9976:1868815139910272:0@lo:502: 00000100:00100000:1.0:1782241148.230953:0:9976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.230970:0:9976:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748480 going to sleep for 11 seconds 00000100:00100000:2.0:1782241148.231062:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139909376 00000100:00100000:2.0:1782241148.231067:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139909376 00000100:00100000:2.0:1782241148.231100:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139909120 00000100:00100000:2.0:1782241148.231103:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139909120 00000100:00100000:2.0:1782241148.231116:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782241148.231122:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139909376:12345-0@lo:400: 00000100:00100000:2.0:1782241148.231169:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139909376:12345-0@lo:400: Request processed in 47us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.231175:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782241148.231188:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782241148.231193:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139909120:12345-0@lo:400: 00000100:00100000:2.0:1782241148.231225:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139909120:12345-0@lo:400: Request processed in 32us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.231231:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782241148.231249:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139908992 00000100:00100000:2.0:1782241148.231252:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139908992 00000100:00100000:2.0:1782241148.231269:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139909504 00000100:00100000:2.0:1782241148.231271:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139909504 00000004:00080000:0.0:1782241148.231402:0:9974:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782241148.231499:0:9974:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 211489741312ns, next at 0ns, rc = 0 00080000:00080000:0.0:1782241148.231506:0:9974:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1782241148.232567:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139910016 00000100:00100000:2.0:1782241148.232576:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139910016 00000100:00100000:2.0:1782241148.232596:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139909632 00000100:00100000:2.0:1782241148.232598:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139909632 00000100:00100000:2.0:1782241148.232620:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139910144 00000100:00100000:2.0:1782241148.232623:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139910144 00000100:00100000:2.0:1782241148.232635:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139909248 00000100:00100000:2.0:1782241148.232638:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139909248 00000100:00100000:2.0:1782241148.232666:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782241148.232673:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139908992:12345-0@lo:400: 00000100:00100000:2.0:1782241148.232781:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139908992:12345-0@lo:400: Request processed in 108us (2827us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.232789:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782241148.232805:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782241148.232812:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139909504:12345-0@lo:400: 00000100:00100000:2.0:1782241148.232845:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139909504:12345-0@lo:400: Request processed in 33us (2850us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.232851:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782241148.232862:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782241148.232868:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815139910016:12345-0@lo:400: 00000100:00100000:2.0:1782241148.232899:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815139910016:12345-0@lo:400: Request processed in 30us (2865us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.232906:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782241148.232916:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782241148.232922:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139909632:12345-0@lo:400: 00000100:00100000:2.0:1782241148.232953:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139909632:12345-0@lo:400: Request processed in 32us (2823us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.232959:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782241148.232970:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782241148.232975:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815139910144:12345-0@lo:400: 00000100:00100000:2.0:1782241148.233007:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815139910144:12345-0@lo:400: Request processed in 31us (2843us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.233012:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782241148.233023:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782241148.233035:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139909248:12345-0@lo:400: 00000100:00100000:2.0:1782241148.233069:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139909248:12345-0@lo:400: Request processed in 34us (2858us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.233075:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1782241148.233107:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241148.233111:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241148.233122:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139910272 00000100:00100000:2.0:1782241148.233126:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139910272 00000100:00100000:2.0:1782241148.233154:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1782241148.233159:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+21:9976:x1868815139910272:12345-0@lo:502: 00000100:00100000:2.0:1782241148.233265:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+21:9976:x1868815139910272:12345-0@lo:502: Request processed in 105us (2311us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.233271:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1782241148.233814:0:9976:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9976:1868815139910272:0@lo:502: 00000040:00080000:1.0:1782241148.233853:0:9976:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00010000:00080000:2.0:1782241148.236192:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476efb80 x1868815139909248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241148.236210:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139909248:0@lo:400: 00000100:00100000:2.0:1782241148.236224:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139909120:0@lo:400: 00010000:00080000:2.0:1782241148.236236:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476eca80 x1868815139909632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241148.236245:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139909632:0@lo:400: 00010000:00080000:2.0:1782241148.236256:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476ece00 x1868815139910144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241148.236265:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815139910144:0@lo:400: 00010000:00080000:2.0:1782241148.236307:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4684df80 x1868815139908992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241148.236334:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4684df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139908992:0@lo:400: 00010000:00080000:2.0:1782241148.236349:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476ed180 x1868815139909504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241148.236356:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139909504:0@lo:400: 00010000:00080000:2.0:1782241148.236367:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476ef100 x1868815139910016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241148.236374:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815139910016:0@lo:400: 00000100:00100000:2.0:1782241148.236384:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139909376:0@lo:400: 00000100:00100000:2.0:1782241148.236444:0:9975:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9975:1868815139910400:0@lo:700: 00000100:00100000:2.0:1782241148.236504:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.236572:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139910400 00000100:00100000:2.0:1782241148.236578:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139910400 00000100:00100000:2.0:1782241148.236638:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782241148.236648:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9975:x1868815139910400:12345-0@lo:700: 00000100:00100000:2.0:1782241148.236684:0:8433:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8433:1868815139910528:0@lo:700: 00000100:00100000:2.0:1782241148.236709:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.236731:0:8433:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d467f1600 going to sleep for 11 seconds 00000100:00080000:2.0:1782241148.236744:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782241148.236753:0:9975:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d467f1240 going to sleep for 11 seconds 00000100:00100000:1.0:1782241148.238575:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139910528 00000100:00100000:1.0:1782241148.238584:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139910528 00000100:00100000:1.0:1782241148.238639:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782241148.238661:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8433:x1868815139910528:12345-0@lo:700: 00000020:01000000:0.0:1782241148.247937:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1782241148.247984:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782241148.247999:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1964c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241148.248011:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1964c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241148.248021:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782241148.248024:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890e48138000 from 6 10000000:01000000:0.0:1782241148.248047:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782241148.248091:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241148.248101:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241148.248112:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241148.248135:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139910656:0@lo:101: 00000100:00100000:0.0:1782241148.248203:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241148.248294:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d300 going to sleep for 11 seconds 00000100:00100000:1.0:1782241148.248499:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139910656 00000100:00100000:1.0:1782241148.248508:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139910656 00000100:00100000:1.0:1782241148.248569:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1782241148.248578:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139910656:12345-0@lo:101: 00010000:00010000:1.0:1782241148.248591:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241148.248604:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e19661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1965a expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.248641:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e19661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1965a expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.248651:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e19661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1965a expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.248660:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c000, rc 0) 00000100:00100000:1.0:1782241148.248714:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139910656:12345-0@lo:101: Request processed in 138us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.248720:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1782241148.248841:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139910656:0@lo:101: 00010000:00010000:3.0:1782241148.248857:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241148.248865:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241148.248927:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139910784:0@lo:256: 00000100:00100000:3.0:1782241148.248959:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241148.248991:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e779823c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241148.249091:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139910784 00000100:00100000:1.0:1782241148.249095:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139910784 00000100:00100000:1.0:1782241148.249126:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782241148.249133:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139910784:12345-0@lo:256: 20000000:01000000:1.0:1782241148.249146:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782241148.249164:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782241148.249168:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1782241148.249239:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139910784:12345-0@lo:256: Request processed in 106us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.249247:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782241148.249280:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139910784:0@lo:256: 10000000:01000000:1.0:1782241148.249333:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782241148.249340:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.249349:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241148.249357:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1782241148.249359:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1782241148.249362:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782241148.249377:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e19668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.249385:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e19668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.249393:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e19668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241148.249404:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139910912:0@lo:101: 00000100:00100000:1.0:1782241148.249429:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.249441:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748840 going to sleep for 11 seconds 00000100:00100000:1.0:1782241148.249451:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139910912 00000100:00100000:1.0:1782241148.249454:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139910912 00000100:00100000:1.0:1782241148.249470:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1782241148.249476:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139910912:12345-0@lo:101: 00010000:00010000:1.0:1782241148.249483:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241148.249491:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1966f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19668 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.249511:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1966f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19668 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.249520:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1966f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19668 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.249527:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d200, rc 0) 00000100:00100000:1.0:1782241148.249551:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139910912:12345-0@lo:101: Request processed in 75us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.249557:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1782241148.249584:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139910912:0@lo:101: 00010000:00010000:1.0:1782241148.249594:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e19668 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1966f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.249601:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e19668 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1966f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241148.249664:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139911040:0@lo:501: 00000100:00100000:1.0:1782241148.249686:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.249698:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748840 going to sleep for 11 seconds 00000100:00100000:1.0:1782241148.249709:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139911040 00000100:00100000:1.0:1782241148.249711:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139911040 00000100:00100000:1.0:1782241148.249726:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1782241148.249732:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139911040:12345-0@lo:501: 00000100:00100000:1.0:1782241148.249881:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139911040:12345-0@lo:501: Request processed in 148us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.249888:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1782241148.249925:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139911040:0@lo:501: 00000100:00100000:1.0:1782241148.249950:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139911168:0@lo:503: 00000100:00100000:1.0:1782241148.249987:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.250007:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748840 going to sleep for 11 seconds 00000100:00100000:1.0:1782241148.250017:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139911168 00000100:00100000:1.0:1782241148.250020:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139911168 00000100:00100000:1.0:1782241148.250036:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1782241148.250041:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139911168:12345-0@lo:503: 00000100:00100000:1.0:1782241148.250121:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139911168:12345-0@lo:503: Request processed in 78us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.250127:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1782241148.250164:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139911168:0@lo:503: 00000100:00100000:1.0:1782241148.250339:0:9977:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9977:1868815139911296:0@lo:502: 00000100:00100000:1.0:1782241148.250372:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.250389:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139911296 00000100:00100000:1.0:1782241148.250392:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139911296 00000100:00100000:1.0:1782241148.250408:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1782241148.250413:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:9977:x1868815139911296:12345-0@lo:502: 00000100:00100000:1.0:1782241148.250477:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:9977:x1868815139911296:12345-0@lo:502: Request processed in 63us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.250484:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1782241148.250510:0:9977:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241148.250521:0:9977:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9977:1868815139911296:0@lo:502: 00000020:01000000:1.0:1782241148.250540:0:9977:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782241148.250548:0:9977:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1782241148.250554:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241148.250560:0:9977:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1782241148.250566:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782241148.250569:0:9977:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:01000000:1.0:1782241148.250588:0:9977:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782241148.250591:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782241148.250604:0:9977:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff890d46918000) 00000020:00000080:1.0:1782241148.250639:0:9977:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1782241148.250646:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782241148.250727:0:9977:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1782241148.250734:0:9977:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1782241148.250741:0:9977:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1967d 00010000:00080000:1.0:1782241148.250797:0:9977:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d4797a000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241148.251041:0:9977:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1782241148.251183:0:9977:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1782241148.251194:0:9977:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1782241148.251378:0:9977:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782241148.251489:0:9977:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782241148.251645:0:9977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1782241148.251732:0:9977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000004:00080000:0.0:1782241148.258566:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 40000000:02000000:0.0:1782241148.258969:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000040:00080000:2.0:1782241148.263910:0:9978:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782241148.263920:0:9978:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1782241148.264955:0:9977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782241148.264967:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782241148.265003:0:9977:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1782241148.265030:0:9977:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e19684 00000100:00080000:1.0:1782241148.265043:0:9977:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782241148.265050:0:9977:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff890d4797a000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241148.265086:0:9977:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7785a680 x1868815139911424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241148.265105:0:9977:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1782241148.265158:0:9977:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241148.265162:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241148.265171:0:9977:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1782241148.265175:0:9977:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241148.265180:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241148.265181:0:9977:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782241148.265184:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782241148.265186:0:9977:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1782241148.265214:0:9977:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9977:1868815139911552:0@lo:502: 00000100:00100000:1.0:1782241148.265303:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.265340:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139911552 00000100:00100000:1.0:1782241148.265345:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139911552 00000100:00100000:1.0:1782241148.265384:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1782241148.265392:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:9977:x1868815139911552:12345-0@lo:502: 00000100:00100000:1.0:1782241148.265504:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:9977:x1868815139911552:12345-0@lo:502: Request processed in 112us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.265511:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1782241148.265564:0:9977:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241148.265586:0:9977:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:9977:1868815139911552:0@lo:502: 00000020:01000000:1.0:1782241148.265623:0:9977:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241148.265628:0:9977:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241148.265629:0:9977:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782241148.265633:0:9977:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:1.0:1782241148.265682:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1782241148.265703:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782241148.265713:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e19668 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1966f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.265724:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e19668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1966f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241148.265735:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1782241148.265743:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff890e43633380 from 1 10000000:01000000:1.0:1782241148.265747:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782241148.265799:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1968b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.265808:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1968b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.265817:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1968b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241148.265829:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139911680:0@lo:101: 00000100:00100000:1.0:1782241148.265855:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.265877:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e437483c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241148.265891:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139911680 00000100:00100000:1.0:1782241148.265896:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139911680 00000100:00100000:1.0:1782241148.265918:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1782241148.265925:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139911680:12345-0@lo:101: 00010000:00010000:1.0:1782241148.265934:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241148.265946:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e19692 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1968b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.265966:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e19692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1968b expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.265976:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e19692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1968b expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.265985:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164de00, rc 0) 00000100:00100000:1.0:1782241148.266014:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139911680:12345-0@lo:101: Request processed in 89us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.266025:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1782241148.266056:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139911680:0@lo:101: 00010000:00010000:1.0:1782241148.266068:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1968b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19692 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.266075:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1968b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19692 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241148.266113:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139911808:0@lo:501: 00000100:00100000:1.0:1782241148.266135:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.266147:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241148.266157:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139911808 00000100:00100000:1.0:1782241148.266160:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139911808 00000100:00100000:1.0:1782241148.266181:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1782241148.266186:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139911808:12345-0@lo:501: 00000100:00100000:1.0:1782241148.266249:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139911808:12345-0@lo:501: Request processed in 61us (112us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782241148.266255:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1782241148.266282:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139911808:0@lo:501: 10000000:01000000:1.0:1782241148.266299:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782241148.266303:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1968b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19692 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241148.266309:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1968b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19692 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241148.267175:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815139911424:0@lo:8: 00000100:00100000:2.0:1782241148.267223:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.267420:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139911424 00000100:00100000:1.0:1782241148.267427:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139911424 00000100:00100000:1.0:1782241148.267467:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782241148.267474:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1868815139911424:12345-0@lo:8: 00010000:00080000:1.0:1782241148.267502:0:8746:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:1.0:1782241148.267529:0:8746:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e19699 00002000:00100000:1.0:1782241148.267542:0:8746:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff890d47979000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1782241148.267546:0:8746:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1782241148.267549:0:8746:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782241148.267634:0:8746:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782241148.267659:0:8746:0:(import.c:65:import_set_state_nolock()) ffff890d4797d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241148.267775:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1868815139911424:12345-0@lo:8: Request processed in 281us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.267782:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1782241148.267982:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7785a680 x1868815139911424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782241158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241148.267992:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782241148.267999:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1782241148.268005:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1782241148.268010:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1782241148.268012:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d4797a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1782241148.268031:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1782241148.268037:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815139911424:0@lo:8: 00000004:00080000:2.0:1782241148.268097:0:9978:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1782241148.268150:0:9978:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 211526392731ns, next at 0ns, rc = 0 00080000:00080000:2.0:1782241148.268156:0:9978:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1782241148.271129:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1782241148.271251:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139911936:0@lo:13: 00000100:00100000:2.0:1782241148.271328:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.271408:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139911936 00000100:00100000:2.0:1782241148.271415:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139911936 00000100:00100000:2.0:1782241148.271475:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782241148.271483:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1868815139911936:12345-0@lo:13: 00002000:00000024:2.0:1782241148.271510:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1782241148.271558:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1868815139911936:12345-0@lo:13: Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.271565:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1782241148.271584:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782241148.271619:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47830e00 x1868815139911936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241148.271639:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139911936:0@lo:13: 00000004:00080000:2.0:1782241148.271658:0:9979:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1782241148.271676:0:9979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9979:1868815139912064:0@lo:7: 00000100:00100000:2.0:1782241148.271702:0:9979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.271729:0:9979:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d467f19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241148.274668:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139912064 00000100:00100000:1.0:1782241148.274681:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139912064 00000100:00100000:1.0:1782241148.274751:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782241148.274784:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9979:x1868815139912064:12345-0@lo:7: 00000100:00100000:0.0:1782241148.276067:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8433:x1868815139910528:12345-0@lo:700: Request processed in 37404us (39352us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241148.276080:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782241148.276175:0:8433:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47830000 x1868815139910528/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782241164 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241148.276190:0:8433:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8433:1868815139910528:0@lo:700: 40000000:02000000:2.0:1782241148.276201:0:8433:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000001:00100000:2.0:1782241148.286707:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1782241148.286716:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1782241148.286891:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9975:x1868815139910400:12345-0@lo:700: Request processed in 50240us (50381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241148.286909:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782241148.287052:0:9975:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47833b80 x1868815139910400/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782241164 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241148.287068:0:9975:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9975:1868815139910400:0@lo:700: 00002000:00080000:1.0:1782241148.291484:0:8423:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1782241148.291492:0:8423:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1782241148.291597:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9979:x1868815139912064:12345-0@lo:7: Request processed in 16811us (19889us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241148.291620:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1782241148.291705:0:9979:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47830e00 x1868815139912064/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782241164 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241148.291720:0:9979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9979:1868815139912064:0@lo:7: 00000004:00080000:2.0:1782241148.291734:0:9979:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1782241148.291870:0:9979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9979:1868815139912192:0@lo:5: 00000100:00100000:2.0:1782241148.291911:0:9979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241148.292044:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139912192 00000100:00100000:1.0:1782241148.292050:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139912192 00000100:00100000:2.0:1782241148.292052:0:9979:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d467f19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241148.292217:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241148.292500:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9979:x1868815139912192:12345-0@lo:5: 00002000:00080000:1.0:1782241148.292528:0:8426:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1782241148.292532:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1782241148.294081:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9979:x1868815139912192:12345-0@lo:5: Request processed in 1843us (2164us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1782241148.294093:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1782241148.294202:0:9979:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47830e00 x1868815139912192/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782241164 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241148.294220:0:9979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9979:1868815139912192:0@lo:5: 00000004:00080000:0.0:1782241148.294234:0:9979:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1782241148.294271:0:9979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9979:1868815139912320:0@lo:700: 00000100:00100000:0.0:1782241148.294316:0:9979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241148.294382:0:9979:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241148.294483:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139912320 00000100:00100000:2.0:1782241148.294489:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139912320 00000100:00100000:2.0:1782241148.294535:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782241148.294543:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9979:x1868815139912320:12345-0@lo:700: 00000100:00100000:1.0:1782241148.298948:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139912448:0@lo:13: 00000100:00100000:1.0:1782241148.299013:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1782241148.299094:0:9975:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1782241148.299123:0:9975:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4684df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9975:1868815139912576:0@lo:7: 00000100:00100000:2.0:1782241148.299172:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.299230:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139912576 00000100:00100000:2.0:1782241148.299237:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139912576 00000100:00100000:3.0:1782241148.299387:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139912448 00000100:00100000:3.0:1782241148.299392:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139912448 00000100:00100000:3.0:1782241148.299420:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782241148.299428:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1868815139912448:12345-0@lo:13: 00002000:00000024:3.0:1782241148.299448:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1782241148.299500:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782241148.299509:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:9975:x1868815139912576:12345-0@lo:7: 00002000:00080000:2.0:1782241148.303566:0:8747:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1782241148.303575:0:8747:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1782241148.303706:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:9975:x1868815139912576:12345-0@lo:7: Request processed in 4193us (4529us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.303719:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782241148.303820:0:9975:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d467f1240 going to sleep for 11 seconds 00010000:00080000:2.0:1782241148.303848:0:9975:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4684df80 x1868815139912576/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782241164 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241148.303862:0:9975:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4684df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9975:1868815139912576:0@lo:7: 00000004:00080000:2.0:1782241148.303875:0:9975:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1782241148.303913:0:9975:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47855880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9975:1868815139912704:0@lo:5: 00000100:00100000:2.0:1782241148.303944:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241148.303970:0:9975:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d467f1240 going to sleep for 11 seconds 00000100:00100000:0.0:1782241148.304987:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139912704 00000100:00100000:0.0:1782241148.304996:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139912704 00000100:00100000:0.0:1782241148.305054:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782241148.305074:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47855180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9975:x1868815139912704:12345-0@lo:5: 00002000:00080000:0.0:1782241148.305104:0:8423:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1782241148.305182:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47855180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9975:x1868815139912704:12345-0@lo:5: Request processed in 110us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241148.305189:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1782241148.305268:0:9975:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47855880 x1868815139912704/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782241164 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241148.305292:0:9975:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47855880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9975:1868815139912704:0@lo:5: 00000004:00080000:2.0:1782241148.305303:0:9975:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1782241148.305409:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139912448:12345-0@lo:13: Request processed in 5980us (6394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241148.305418:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1782241148.305500:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47830000 x1868815139912448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241148.305518:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139912448:0@lo:13: 00000001:00080000:3.0:1782241148.310416:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1782241148.316494:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9979:x1868815139912320:12345-0@lo:700: Request processed in 21934us (22160us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241148.316516:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782241148.316550:0:9979:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e47aeaa00 x1868815139912320/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782241164 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241148.316568:0:9979:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1782241148.316592:0:9979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9979:1868815139912320:0@lo:700: 00000004:02000040:0.0:1782241148.320664:0:9979:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1782241148.332016:0:9979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9979:1868815139912832:0@lo:5: 00000100:00100000:0.0:1782241148.332207:0:9979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241148.332540:0:9979:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241148.337005:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139912832 00000100:00100000:2.0:1782241148.337030:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139912832 00000100:00100000:3.0:1782241148.339716:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782241148.339775:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9979:x1868815139912832:12345-0@lo:5: 00002000:00080000:2.0:1782241148.363311:0:8426:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1782241148.363344:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1782241148.378414:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9979:x1868815139912832:12345-0@lo:5: Request processed in 38651us (46196us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1782241148.378434:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1782241148.378586:0:9979:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e47aeaa00 x1868815139912832/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782241164 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241148.378644:0:9979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9979:1868815139912832:0@lo:5: 00000004:00080000:2.0:1782241148.378665:0:9979:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1782241148.550388:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782241148.630149:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1782241148.688816:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47855880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139912960:0@lo:41: 00000100:00100000:3.0:1782241148.688917:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241148.689018:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139912960 00000100:00100000:3.0:1782241148.689029:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139912960 00000100:00100000:3.0:1782241148.689087:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782241148.689098:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139912960:12345-0@lo:41: 00000004:00000024:3.0:1782241148.689145:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782241148.689199:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139912960:12345-0@lo:41: Request processed in 100us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241148.689207:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782241148.689284:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47855880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139912960:0@lo:41: 00010000:00010000:3.0:1782241149.575953:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782241149.678288:0:10030:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782241149.678545:0:10030:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1782241150.216177:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241150.216216:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139913088:0@lo:13: 00000100:00100000:3.0:1782241150.216325:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241150.216521:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139913088 00000100:00100000:0.0:1782241150.216538:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139913088 00000100:00100000:0.0:1782241150.216617:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782241150.216640:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139913088:12345-0@lo:13: 00002000:00000024:0.0:1782241150.216683:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241150.216807:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139913088:12345-0@lo:13: Request processed in 180us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241150.217034:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1782241150.217090:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241150.217137:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139913216:0@lo:13: 00000100:00100000:2.0:1782241150.217181:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1782241150.217268:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e778dd180 x1868815139913088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241150.217303:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139913088:0@lo:13: 00000100:00100000:2.0:1782241150.217345:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139913216 00000100:00100000:2.0:1782241150.217350:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139913216 00000100:00100000:2.0:1782241150.217385:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782241150.217393:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139913216:12345-0@lo:13: 00002000:00000024:2.0:1782241150.217406:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241150.217447:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139913216:12345-0@lo:13: Request processed in 55us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241150.217454:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1782241150.217484:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e47aead80 x1868815139913216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241150.217497:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139913216:0@lo:13: 00000100:00080000:0.0:1782241150.218110:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782241150.597597:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782241150.830713:0:10078:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782241150.830733:0:10078:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1782241151.621134:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241152.261261:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241152.261343:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139913344:0@lo:41: 00000100:00100000:0.0:1782241152.261491:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241152.261572:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139913344 00000100:00100000:1.0:1782241152.261588:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139913344 00000100:00100000:1.0:1782241152.261687:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782241152.261699:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139913344:12345-0@lo:41: 00000004:00000024:1.0:1782241152.261788:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1782241152.269061:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139913344:12345-0@lo:41: Request processed in 7346us (7552us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241152.269082:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782241152.269284:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139913344:0@lo:41: 00000100:00100000:1.0:1782241152.422006:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241152.424553:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119942016 00000100:00100000:2.0:1782241152.424578:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119942016 00000100:00100000:2.0:1782241152.424932:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 181 00000100:00100000:2.0:1782241152.424979:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2395:x1868815119942016:12345-192.168.204.58@tcp:250: 00010000:00080000:2.0:1782241152.425020:0:6503:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 061bd6f5-9369-4a7c-80a4-94b8e73a58d0@192.168.204.58@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:2.0:1782241152.425058:0:6503:0:(genops.c:1406:class_connect()) connect: client 061bd6f5-9369-4a7c-80a4-94b8e73a58d0, cookie 0xc9959f2fb1e196a0 00000100:00080000:2.0:1782241152.426188:0:6503:0:(import.c:65:import_set_state_nolock()) ffff890e77aaf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241152.426312:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+5:2395:x1868815119942016:12345-192.168.204.58@tcp:250: Request processed in 1331us (4317us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241152.426324:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 181 00000100:00100000:2.0:1782241152.438242:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241152.438494:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119941888 00000100:00100000:1.0:1782241152.438508:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119941888 00000100:00100000:1.0:1782241152.438600:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 182 00000100:00100000:1.0:1782241152.438612:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+5:6155:x1868815119941888:12345-192.168.204.58@tcp:101: 00010000:00010000:1.0:1782241152.438646:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241152.438669:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e82056c00/0xc9959f2fb1e196a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d333504fa5 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241152.438718:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e82056c00/0xc9959f2fb1e196a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fa5 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241152.438795:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e82056c00/0xc9959f2fb1e196a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fa5 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241152.438811:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e82056c00, rc 0) 00000100:00100000:1.0:1782241152.438899:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+6:6155:x1868815119941888:12345-192.168.204.58@tcp:101: Request processed in 289us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241152.438908:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 182 00000100:00100000:3.0:1782241152.444139:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241152.444841:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119942144 00000100:00100000:2.0:1782241152.444856:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119942144 00000100:00100000:2.0:1782241152.444936:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 183 00000100:00100000:2.0:1782241152.444959:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+6:6155:x1868815119942144:12345-192.168.204.58@tcp:501: 00000100:00100000:2.0:1782241152.445146:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+6:6155:x1868815119942144:12345-192.168.204.58@tcp:501: Request processed in 199us (1023us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782241152.445155:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 183 00000100:00100000:0.0:1782241152.452024:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241152.452850:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119942272 00000100:00100000:2.0:1782241152.452867:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119942272 00000100:00100000:2.0:1782241152.453011:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 184 00000100:00100000:2.0:1782241152.453025:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+6:6155:x1868815119942272:12345-192.168.204.58@tcp:101: 00010000:00010000:2.0:1782241152.453050:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241152.453075:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e196ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d333504fac expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241152.453192:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e196ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fac expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241152.453206:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e196ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fac expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241152.453236:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860200, rc 0) 00000100:00100000:2.0:1782241152.453319:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+7:6155:x1868815119942272:12345-192.168.204.58@tcp:101: Request processed in 296us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241152.453328:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 184 00000100:00100000:3.0:1782241152.458016:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241152.458962:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119942400 00000100:00100000:1.0:1782241152.458978:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119942400 00000100:00100000:1.0:1782241152.459065:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 185 00000100:00100000:1.0:1782241152.459079:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+7:6155:x1868815119942400:12345-192.168.204.58@tcp:501: 00000100:00100000:1.0:1782241152.459341:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+8:6155:x1868815119942400:12345-192.168.204.58@tcp:501: Request processed in 263us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241152.459351:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 185 00000100:00100000:3.0:1782241152.476062:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241152.478534:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119942528 00000100:00100000:1.0:1782241152.478555:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119942528 00000100:00100000:1.0:1782241152.478663:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 186 00000100:00100000:1.0:1782241152.478675:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+8:6155:x1868815119942528:12345-192.168.204.58@tcp:503: 00000100:00100000:1.0:1782241152.479043:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+8:6155:x1868815119942528:12345-192.168.204.58@tcp:503: Request processed in 367us (2994us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241152.479053:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 186 00000100:00100000:0.0:1782241152.486504:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241152.486746:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119942656 00000100:00100000:2.0:1782241152.486798:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119942656 00000100:00100000:2.0:1782241152.486876:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 187 00000100:00100000:2.0:1782241152.486888:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+8:6174:x1868815119942656:12345-192.168.204.58@tcp:502: 00000100:00100000:2.0:1782241152.487271:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+8:6174:x1868815119942656:12345-192.168.204.58@tcp:502: Request processed in 382us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241152.487280:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 187 00000100:00100000:3.0:1782241152.541619:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241152.543698:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119942784 00000100:00100000:2.0:1782241152.543717:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119942784 00000100:00100000:2.0:1782241152.543859:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 188 00000100:00100000:2.0:1782241152.543872:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+8:6174:x1868815119942784:12345-192.168.204.58@tcp:502: 00000100:00100000:2.0:1782241152.544739:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+8:6174:x1868815119942784:12345-192.168.204.58@tcp:502: Request processed in 210us (2477us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241152.544797:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 188 00000100:00100000:3.0:1782241152.546491:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241152.547417:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119942912 00000100:00100000:0.0:1782241152.547434:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119942912 00000100:00100000:0.0:1782241152.547517:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 189 00000100:00100000:0.0:1782241152.547549:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+8:6155:x1868815119942912:12345-192.168.204.58@tcp:101: 00010000:00010000:0.0:1782241152.547572:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241152.547597:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e821c2800/0xc9959f2fb1e196b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d333504fdd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241152.547635:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e821c2800/0xc9959f2fb1e196b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fdd expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241152.547649:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e821c2800/0xc9959f2fb1e196b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fdd expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241152.547659:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e821c2800, rc 0) 00000100:00100000:0.0:1782241152.547739:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:6155:x1868815119942912:12345-192.168.204.58@tcp:101: Request processed in 211us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241152.547747:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 189 00000100:00100000:0.0:1782241152.555429:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241152.555602:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119943040 00000100:00100000:1.0:1782241152.555615:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119943040 00000100:00100000:1.0:1782241152.555686:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 190 00000100:00100000:1.0:1782241152.555698:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:6155:x1868815119943040:12345-192.168.204.58@tcp:256: 20000000:01000000:1.0:1782241152.555843:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782241152.555865:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782241152.555870:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782241152.555874:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782241152.555878:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1782241152.555881:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1782241152.568662:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:6155:x1868815119943040:12345-192.168.204.58@tcp:256: Request processed in 12948us (13346us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241152.568683:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 190 00000100:00100000:3.0:1782241152.573816:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241152.574142:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119943168 00000100:00100000:2.0:1782241152.574156:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119943168 00000100:00100000:2.0:1782241152.574348:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 191 00000100:00100000:2.0:1782241152.574360:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:6155:x1868815119943168:12345-192.168.204.58@tcp:101: 00010000:00010000:2.0:1782241152.574382:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241152.574405:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e196bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d333504fe4 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241152.574459:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e196bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fe4 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241152.574472:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e196bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fe4 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241152.574483:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860400, rc 0) 00000100:00100000:2.0:1782241152.574567:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6155:x1868815119943168:12345-192.168.204.58@tcp:101: Request processed in 208us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241152.574576:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 191 00000100:00100000:0.0:1782241152.584188:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241152.584360:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119943296 00000100:00100000:1.0:1782241152.584373:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119943296 00000100:00100000:1.0:1782241152.584453:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 192 00000100:00100000:1.0:1782241152.584466:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b8a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6155:x1868815119943296:12345-192.168.204.58@tcp:501: 00000100:00100000:1.0:1782241152.584688:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b8a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6155:x1868815119943296:12345-192.168.204.58@tcp:501: Request processed in 224us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241152.584698:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 192 00000100:00100000:3.0:1782241152.589480:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241152.589730:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119943424 00000100:00100000:1.0:1782241152.589744:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119943424 00000100:00100000:1.0:1782241152.589856:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 193 00000100:00100000:1.0:1782241152.589868:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b8a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6155:x1868815119943424:12345-192.168.204.58@tcp:503: 00000100:00100000:1.0:1782241152.590086:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b8a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6155:x1868815119943424:12345-192.168.204.58@tcp:503: Request processed in 218us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241152.590095:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 193 00000100:00100000:0.0:1782241152.599613:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241152.599889:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119943552 00000100:00100000:2.0:1782241152.599904:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119943552 00000100:00100000:2.0:1782241152.599984:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 194 00000100:00100000:2.0:1782241152.599996:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b8a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6180:x1868815119943552:12345-192.168.204.58@tcp:502: 00000100:00100000:2.0:1782241152.600461:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b8a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6180:x1868815119943552:12345-192.168.204.58@tcp:502: Request processed in 464us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241152.600472:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 194 00000100:00100000:3.0:1782241152.613011:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241152.613351:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119943680 00000100:00100000:2.0:1782241152.613365:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119943680 00000100:00100000:2.0:1782241152.613448:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 195 00000100:00100000:2.0:1782241152.613462:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6180:x1868815119943680:12345-192.168.204.58@tcp:502: 00000100:00100000:2.0:1782241152.613675:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6180:x1868815119943680:12345-192.168.204.58@tcp:502: Request processed in 216us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241152.613684:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 195 00000100:00100000:3.0:1782241152.619362:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241152.619429:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241152.623332:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119943808 00000100:00100000:0.0:1782241152.623356:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119943808 00000100:00100000:0.0:1782241152.623513:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119944064 00000100:00100000:0.0:1782241152.623517:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119944064 00000100:00100000:0.0:1782241152.623557:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:0.0:1782241152.623567:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1868815119943808:12345-192.168.204.58@tcp:38: 00010000:00080000:0.0:1782241152.623608:0:6510:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:0.0:1782241152.623720:0:6510:0:(genops.c:1406:class_connect()) connect: client 8052d7b9-50cc-405f-b8e0-5c9d863c1c52, cookie 0xc9959f2fb1e196c3 00000004:00100000:0.0:1782241152.623773:0:6510:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782241152.624538:0:6510:0:(import.c:65:import_set_state_nolock()) ffff890d4797b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241152.624652:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2395:x1868815119943808:12345-192.168.204.58@tcp:38: Request processed in 1084us (5756us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241152.624677:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:1.0:1782241152.624718:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 8 00000100:00100000:1.0:1782241152.624725:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1868815119944064:12345-192.168.204.58@tcp:38: 00010000:00080000:1.0:1782241152.624747:0:6510:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:1.0:1782241152.624823:0:6510:0:(genops.c:1406:class_connect()) connect: client 8052d7b9-50cc-405f-b8e0-5c9d863c1c52, cookie 0xc9959f2fb1e196ca 00000004:00100000:1.0:1782241152.624848:0:6510:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782241152.625328:0:6510:0:(import.c:65:import_set_state_nolock()) ffff890d4797a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241152.625369:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2395:x1868815119944064:12345-192.168.204.58@tcp:38: Request processed in 642us (5940us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241152.625377:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 8 00010000:00010000:0.0:1782241152.645573:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241153.287805:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782241153.287843:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139913472:0@lo:13: 00000100:00100000:1.0:1782241153.287960:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241153.288273:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139913472 00000100:00100000:2.0:1782241153.288312:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139913472 00000100:00100000:2.0:1782241153.288409:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782241153.288421:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139913472:12345-0@lo:13: 00002000:00000024:2.0:1782241153.288460:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241153.288548:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139913472:12345-0@lo:13: Request processed in 130us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241153.288556:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1782241153.288710:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782241153.288746:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47856300 x1868815139913472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241153.288788:0:3637:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1782241153.288813:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139913472:0@lo:13: 00000100:00100000:1.0:1782241153.289396:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139913856:0@lo:400: 00000100:00100000:1.0:1782241153.289442:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241153.289499:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139913600:0@lo:400: 00000100:00100000:0.0:1782241153.289549:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241153.289616:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241153.289621:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47854700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815139913728:0@lo:400: 00000100:00100000:0.0:1782241153.289646:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241153.289679:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139913728 00000100:00100000:0.0:1782241153.289684:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139913728 00000100:00100000:0.0:1782241153.289727:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782241153.289735:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815139913728:12345-0@lo:400: 00000100:00100000:0.0:1782241153.289806:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815139913728:12345-0@lo:400: Request processed in 72us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241153.289814:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1782241153.289848:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47854700 x1868815139913728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241153.289860:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47854700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815139913728:0@lo:400: 00000100:00100000:3.0:1782241153.290127:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139913856 00000100:00100000:3.0:1782241153.290141:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139913856 00000100:00100000:3.0:1782241153.290182:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782241153.290190:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139913856:12345-0@lo:400: 00000100:00100000:0.0:1782241153.290285:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139913600 00000100:00100000:0.0:1782241153.290290:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139913600 00000100:00100000:0.0:1782241153.290318:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1782241153.290324:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139913600:12345-0@lo:400: 00000100:00100000:0.0:1782241153.290386:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139913600:12345-0@lo:400: Request processed in 61us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241153.290392:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1782241153.290435:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139913600:0@lo:400: 00000100:00100000:0.0:1782241153.290728:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139913984:0@lo:400: 00000100:00100000:0.0:1782241153.290777:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241153.290827:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139913984 00000100:00100000:0.0:1782241153.290831:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139913984 00000100:00100000:0.0:1782241153.290856:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782241153.290862:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139913984:12345-0@lo:400: 00000100:00100000:0.0:1782241153.290904:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139913984:12345-0@lo:400: Request processed in 42us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241153.290911:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1782241153.290955:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47857800 x1868815139913984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241153.290966:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139913984:0@lo:400: 00000100:00100000:3.0:1782241153.292632:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139913856:12345-0@lo:400: Request processed in 2430us (3176us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241153.292649:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782241153.296619:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139913856:0@lo:400: 00000100:00100000:0.0:1782241153.297282:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139914112:0@lo:400: 00000100:00100000:0.0:1782241153.297560:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241153.297687:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139914112 00000100:00100000:1.0:1782241153.297696:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139914112 00000100:00100000:1.0:1782241153.297833:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782241153.297844:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139914112:12345-0@lo:400: 00000100:00100000:3.0:1782241153.298084:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47854a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815139914240:0@lo:400: 00000100:00100000:3.0:1782241153.298126:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241153.298167:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139914240 00000100:00100000:3.0:1782241153.298171:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139914240 00000100:00100000:3.0:1782241153.298213:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782241153.298221:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815139914240:12345-0@lo:400: 00000100:00100000:3.0:1782241153.298260:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815139914240:12345-0@lo:400: Request processed in 40us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241153.298268:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1782241153.298321:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47854a80 x1868815139914240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241153.298343:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47854a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815139914240:0@lo:400: 00000100:00080000:3.0:1782241153.298396:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241153.302237:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139914112:12345-0@lo:400: Request processed in 4378us (4662us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241153.302257:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782241153.303131:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139914112:0@lo:400: 00000100:00100000:1.0:1782241153.303700:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47855c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139914368:0@lo:400: 00000100:00100000:1.0:1782241153.303820:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241153.303899:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139914624:0@lo:400: 00000100:00100000:1.0:1782241153.305216:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47855500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815139914880:0@lo:400: 00000100:00100000:1.0:1782241153.305280:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241153.305390:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241153.305464:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241153.305471:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815139914752:0@lo:400: 00000100:00100000:3.0:1782241153.306444:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139914496:0@lo:400: 00000100:00100000:3.0:1782241153.306518:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241153.306562:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139915008:0@lo:400: 00000100:00100000:3.0:1782241153.306592:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241153.306660:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139914624 00000100:00100000:3.0:1782241153.306670:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139914624 00000100:00100000:3.0:1782241153.306749:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139914496 00000100:00100000:3.0:1782241153.306753:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139914496 00000100:00100000:3.0:1782241153.306825:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139915008 00000100:00100000:3.0:1782241153.306828:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139915008 00000100:00100000:3.0:1782241153.306847:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782241153.306854:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139914624:12345-0@lo:400: 00000100:00100000:3.0:1782241153.306920:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139914624:12345-0@lo:400: Request processed in 64us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241153.307133:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782241153.307155:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782241153.307163:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139914496:12345-0@lo:400: 00000100:00100000:3.0:1782241153.307203:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139914496:12345-0@lo:400: Request processed in 41us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241153.307211:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782241153.307222:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782241153.307228:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139915008:12345-0@lo:400: 00000100:00100000:3.0:1782241153.307255:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139915008:12345-0@lo:400: Request processed in 27us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241153.307262:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1782241153.307284:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782241153.307289:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782241153.307340:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47856d80 x1868815139914496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241153.307357:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139914496:0@lo:400: 00010000:00080000:3.0:1782241153.307380:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47857b80 x1868815139915008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241153.307391:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139915008:0@lo:400: 00000100:00100000:0.0:1782241153.311686:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241153.315226:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139914368 00000100:00100000:2.0:1782241153.315249:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139914368 00000100:00080000:1.0:1782241153.315497:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782241153.317085:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139914880 00000100:00100000:2.0:1782241153.317102:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139914880 00000100:00100000:2.0:1782241153.317170:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782241153.317182:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139914368:12345-0@lo:400: 00000100:00100000:2.0:1782241153.317358:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139914368:12345-0@lo:400: Request processed in 178us (13538us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241153.317366:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1782241153.317504:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1782241153.317568:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47855c00 x1868815139914368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241153.317586:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47855c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139914368:0@lo:400: 00000100:00100000:2.0:1782241153.318048:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782241153.318060:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815139914880:12345-0@lo:400: 00000100:00100000:2.0:1782241153.318132:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815139914880:12345-0@lo:400: Request processed in 75us (12852us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241153.318139:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1782241153.318310:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47855500 x1868815139914880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241153.318322:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47855500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815139914880:0@lo:400: 00010000:00080000:0.0:1782241153.323833:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47857100 x1868815139914624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241153.323855:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139914624:0@lo:400: 00000100:00100000:3.0:1782241153.325537:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139914752 00000100:00100000:3.0:1782241153.325577:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139914752 00000100:00100000:2.0:1782241153.327114:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782241153.327141:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815139914752:12345-0@lo:400: 00000100:00100000:2.0:1782241153.327378:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815139914752:12345-0@lo:400: Request processed in 249us (15704us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241153.327388:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1782241153.327827:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47856680 x1868815139914752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782241153.327835:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241153.327851:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815139914752:0@lo:400: 00000100:00100000:0.0:1782241153.637379:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241153.637447:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241153.637577:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241153.640291:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119943936 00000100:00100000:2.0:1782241153.640341:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119943936 00000100:00100000:2.0:1782241153.640481:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119944320 00000100:00100000:2.0:1782241153.640486:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119944320 00000100:00100000:2.0:1782241153.640499:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119944192 00000100:00100000:2.0:1782241153.640517:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119944192 00000100:00100000:2.0:1782241153.640550:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00100000:2.0:1782241153.640563:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:0:x1868815119943936:12345-192.168.204.58@tcp:41: 00000004:00000024:2.0:1782241153.640620:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1782241153.640719:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:0:x1868815119943936:12345-192.168.204.58@tcp:41: Request processed in 159us (3357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241153.640728:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00080000:0.0:1782241153.640926:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241153.640932:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241153.641439:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00100000:2.0:1782241153.641453:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:6155:x1868815119944320:12345-192.168.204.58@tcp:41: 00000004:00000024:2.0:1782241153.641476:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1782241153.641535:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:6155:x1868815119944320:12345-192.168.204.58@tcp:41: Request processed in 86us (4087us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241153.641543:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00100000:2.0:1782241153.641559:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:2.0:1782241153.641567:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:0:x1868815119944192:12345-192.168.204.58@tcp:41: 00000004:00000024:2.0:1782241153.641587:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782241153.641617:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:0:x1868815119944192:12345-192.168.204.58@tcp:41: Request processed in 52us (4042us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241153.641623:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:0.0:1782241153.647488:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241153.648359:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119944448 00000100:00100000:2.0:1782241153.648375:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119944448 00000100:00100000:2.0:1782241153.648875:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:2.0:1782241153.648890:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:6155:x1868815119944448:12345-192.168.204.58@tcp:40: 00000100:00100000:2.0:1782241153.649045:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:6155:x1868815119944448:12345-192.168.204.58@tcp:40: Request processed in 159us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241153.649053:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:0.0:1782241153.653648:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241153.653807:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119944832 00000100:00100000:1.0:1782241153.653820:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119944832 00000100:00100000:3.0:1782241153.654064:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:3.0:1782241153.654079:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:6155:x1868815119944832:12345-192.168.204.58@tcp:900: 00000100:00100000:3.0:1782241153.655109:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:6155:x1868815119944832:12345-192.168.204.58@tcp:900: Request processed in 1025us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241153.655122:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:0.0:1782241153.655576:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241153.655623:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241153.655673:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241153.655713:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119944576 00000100:00100000:3.0:1782241153.655723:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119944576 00000100:00100000:3.0:1782241153.655782:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119944704 00000100:00100000:3.0:1782241153.655785:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119944704 00000100:00100000:3.0:1782241153.655808:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00100000:3.0:1782241153.655816:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f60b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2395:x1868815119944576:12345-192.168.204.58@tcp:8: 00010000:00080000:3.0:1782241153.655854:0:8746:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:3.0:1782241153.655893:0:8746:0:(genops.c:1406:class_connect()) connect: client 8052d7b9-50cc-405f-b8e0-5c9d863c1c52, cookie 0xc9959f2fb1e196d1 00000100:00100000:0.0:1782241153.655917:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 16 00002000:00100000:3.0:1782241153.655921:0:8746:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8052d7b9-50cc-405f-b8e0-5c9d863c1c52/ffff890d47590000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1782241153.655938:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2395:x1868815119944704:12345-192.168.204.58@tcp:8: 00002000:00100000:3.0:1782241153.655956:0:8746:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00080000:0.0:1782241153.655962:0:8747:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:0.0:1782241153.655988:0:8747:0:(genops.c:1406:class_connect()) connect: client 8052d7b9-50cc-405f-b8e0-5c9d863c1c52, cookie 0xc9959f2fb1e196d8 00002000:00100000:0.0:1782241153.655996:0:8747:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8052d7b9-50cc-405f-b8e0-5c9d863c1c52/ffff890d469be000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782241153.656032:0:8747:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782241153.656276:0:8747:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1782241153.656295:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119944960 00000100:00100000:1.0:1782241153.656302:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119944960 00000100:00080000:0.0:1782241153.656317:0:8747:0:(import.c:65:import_set_state_nolock()) ffff890d469bf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241153.656352:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 197 00000100:00100000:1.0:1782241153.656362:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2399:x1868815119944960:12345-192.168.204.58@tcp:400: 00000100:00100000:0.0:1782241153.656384:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2395:x1868815119944704:12345-192.168.204.58@tcp:8: Request processed in 457us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241153.656394:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 16 00000100:00100000:1.0:1782241153.656413:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2399:x1868815119944960:12345-192.168.204.58@tcp:400: Request processed in 51us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241153.656422:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 197 00002000:00080000:3.0:1782241153.657004:0:8746:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782241153.657027:0:8746:0:(import.c:65:import_set_state_nolock()) ffff890d47590800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782241153.657069:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f60b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2395:x1868815119944576:12345-192.168.204.58@tcp:8: Request processed in 1251us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241153.657078:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00100000:0.0:1782241153.660913:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241153.661277:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119945088 00000100:00100000:2.0:1782241153.661292:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119945088 00000100:00100000:2.0:1782241153.661363:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:2.0:1782241153.661376:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:6155:x1868815119945088:12345-192.168.204.58@tcp:33: 00010000:00010000:0.0:1782241153.671573:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782241153.697668:0:6513:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 36147us 00000004:00200000:0.0:1782241153.736409:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1782241153.736546:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:6155:x1868815119945088:12345-192.168.204.58@tcp:33: Request processed in 75167us (75655us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241153.736564:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:0.0:1782241153.798118:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139915136:0@lo:13: 00000100:00100000:0.0:1782241153.798196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241153.798312:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139915136 00000100:00100000:1.0:1782241153.798321:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139915136 00000100:00100000:2.0:1782241153.798339:0:9975:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47856680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9975:1868815139915264:0@lo:5: 00000100:00100000:2.0:1782241153.798384:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241153.798408:0:9975:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d467f1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241153.798613:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139915264 00000100:00100000:2.0:1782241153.798618:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139915264 00000100:00100000:2.0:1782241153.798651:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782241153.798660:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9975:x1868815139915264:12345-0@lo:5: 00002000:00080000:2.0:1782241153.798700:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1782241153.798979:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782241153.798987:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1868815139915136:12345-0@lo:13: 00002000:00000024:1.0:1782241153.799146:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241153.804018:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1868815139915136:12345-0@lo:13: Request processed in 5021us (5810us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241153.804034:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1782241153.804788:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47856a00 x1868815139915136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241153.804814:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139915136:0@lo:13: 00000100:00100000:0.0:1782241153.804860:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241153.804871:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139915392:0@lo:41: 00000100:00100000:0.0:1782241153.804932:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241153.805057:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139915392 00000100:00100000:1.0:1782241153.805065:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139915392 00000100:00100000:1.0:1782241153.805113:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782241153.805121:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f60ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139915392:12345-0@lo:41: 00000004:00000024:1.0:1782241153.805156:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241153.805198:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f60ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139915392:12345-0@lo:41: Request processed in 77us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241153.805204:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782241153.805354:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139915392:0@lo:41: 00000100:00100000:2.0:1782241153.808427:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9975:x1868815139915264:12345-0@lo:5: Request processed in 9759us (10034us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1782241153.808440:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1782241153.808704:0:9975:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47856680 x1868815139915264/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782241169 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241153.808722:0:9975:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47856680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9975:1868815139915264:0@lo:5: 00000004:00080000:0.0:1782241153.808753:0:9975:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1782241153.808839:0:9975:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f60b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9975:1868815139915520:0@lo:900: 00000100:00100000:0.0:1782241153.808881:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241153.808921:0:9975:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241153.809203:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139915520 00000100:00100000:1.0:1782241153.809211:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139915520 00000100:00100000:1.0:1782241153.809264:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782241153.809273:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9975:x1868815139915520:12345-0@lo:900: 00000100:00100000:1.0:1782241153.809339:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9975:x1868815139915520:12345-0@lo:900: Request processed in 67us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241153.809347:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1782241153.809468:0:9975:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f60b100 x1868815139915520/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782241169 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241153.809480:0:9975:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f60b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9975:1868815139915520:0@lo:900: 00000100:00100000:1.0:1782241153.993644:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241153.993802:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119945216 00000100:00100000:2.0:1782241153.993813:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119945216 00000100:00100000:2.0:1782241153.993879:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:2.0:1782241153.993890:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:6198:x1868815119945216:12345-192.168.204.58@tcp:101: 00010000:00010000:2.0:1782241153.993929:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241153.994019:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e196df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505015 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241153.994090:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e196e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241153.994236:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e196e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241153.994250:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e196e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241153.994298:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782241153.994302:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782241153.994316:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e196e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241153.994341:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e196df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505015 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241153.994360:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e196e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505015 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241153.994369:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e4bb38e00) 00010000:00010000:2.0:1782241153.994372:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782241153.994375:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861000, rc 0) 00000100:00100000:2.0:1782241153.994532:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:6198:x1868815119945216:12345-192.168.204.58@tcp:101: Request processed in 642us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241153.994539:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 13 00010000:00010000:2.0:1782241154.695965:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241155.333975:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241155.334010:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139915648:0@lo:13: 00000100:00100000:2.0:1782241155.334100:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241155.334312:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139915648 00000100:00100000:0.0:1782241155.334322:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139915648 00000100:00100000:0.0:1782241155.334395:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782241155.334407:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139915648:12345-0@lo:13: 00002000:00000024:0.0:1782241155.334447:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241155.334524:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139915648:12345-0@lo:13: Request processed in 119us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241155.334531:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1782241155.334734:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782241155.334791:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f609500 x1868815139915648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241155.334812:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139915648:0@lo:13: 00000100:00100000:2.0:1782241155.335944:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139915776:0@lo:13: 00000100:00100000:2.0:1782241155.336009:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241155.339629:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139915776 00000100:00100000:0.0:1782241155.339652:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139915776 00000100:00100000:0.0:1782241155.340636:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782241155.340657:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139915776:12345-0@lo:13: 00002000:00000024:0.0:1782241155.340706:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241155.340871:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139915776:12345-0@lo:13: Request processed in 220us (4861us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241155.340880:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1782241155.340937:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782241155.342540:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e778dd180 x1868815139915776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241155.342581:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139915776:0@lo:13: 00010000:00010000:0.0:1782241155.717283:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241156.092370:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241156.092543:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119945344 00000100:00100000:3.0:1782241156.092556:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119945344 00000100:00100000:3.0:1782241156.092666:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 14 00000100:00100000:3.0:1782241156.092680:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:6251:x1868815119945344:12345-192.168.204.58@tcp:41: 00000004:00000024:3.0:1782241156.092729:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:2.0:1782241156.092890:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782241156.094026:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:6251:x1868815119945344:12345-192.168.204.58@tcp:41: Request processed in 1339us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241156.094040:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 14 00000100:00100000:0.0:1782241156.102622:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241156.103381:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119945472 00000100:00100000:2.0:1782241156.103470:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119945472 00000100:00100000:2.0:1782241156.103608:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00100000:2.0:1782241156.103622:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:6251:x1868815119945472:12345-192.168.204.58@tcp:41: 00000004:00000024:2.0:1782241156.103674:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782241156.103812:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:6251:x1868815119945472:12345-192.168.204.58@tcp:41: Request processed in 192us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241156.103821:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00080000:0.0:1782241156.104425:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782241156.111089:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241156.111206:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119945600 00000100:00100000:2.0:1782241156.111219:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119945600 00000100:00100000:2.0:1782241156.111322:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:2.0:1782241156.111334:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:6251:x1868815119945600:12345-192.168.204.58@tcp:13: 00002000:00000024:2.0:1782241156.111369:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241156.111471:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:6251:x1868815119945600:12345-192.168.204.58@tcp:13: Request processed in 139us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241156.111498:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00080000:0.0:1782241156.112440:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241156.118424:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241156.118530:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119945728 00000100:00100000:2.0:1782241156.118544:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119945728 00000100:00100000:2.0:1782241156.118711:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:2.0:1782241156.118724:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:6251:x1868815119945728:12345-192.168.204.58@tcp:13: 00002000:00000024:2.0:1782241156.118798:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241156.118905:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:6251:x1868815119945728:12345-192.168.204.58@tcp:13: Request processed in 183us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241156.118921:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00080000:0.0:1782241156.121399:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782241156.745930:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782241156.873544:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1782241156.873565:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000100:00100000:3.0:1782241157.382979:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139915904:0@lo:41: 00000100:00100000:3.0:1782241157.383084:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241157.383189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139915904 00000100:00100000:3.0:1782241157.383198:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139915904 00000100:00100000:3.0:1782241157.383260:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782241157.383271:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139915904:12345-0@lo:41: 00000004:00000024:3.0:1782241157.383333:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1782241157.383396:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139915904:12345-0@lo:41: Request processed in 126us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241157.383406:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782241157.383485:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139915904:0@lo:41: 00010000:00010000:0.0:1782241157.766678:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241158.405492:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139916160:0@lo:400: 00000100:00100000:0.0:1782241158.405620:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241158.405807:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139916160 00000100:00100000:1.0:1782241158.405823:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139916160 00000100:00100000:1.0:1782241158.405892:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782241158.405902:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139916160:12345-0@lo:400: 00000100:00100000:3.0:1782241158.406370:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139916416:0@lo:400: 00000100:00100000:1.0:1782241158.406552:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139916160:12345-0@lo:400: Request processed in 650us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241158.406562:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782241158.408573:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139916032:0@lo:400: 00000100:00100000:0.0:1782241158.408652:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139916160:0@lo:400: 00000100:00100000:2.0:1782241158.408671:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241158.408732:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139916544:0@lo:400: 00000100:00100000:2.0:1782241158.408788:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241158.408817:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139917056:0@lo:400: 00000100:00100000:2.0:1782241158.408841:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241158.408861:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139917568:0@lo:400: 00000100:00100000:2.0:1782241158.408883:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241158.409195:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241158.409484:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139916928:0@lo:400: 00000100:00100000:1.0:1782241158.409500:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139916032 00000100:00100000:1.0:1782241158.409509:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139916032 00000100:00100000:3.0:1782241158.409517:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241158.409543:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139917440:0@lo:400: 00000100:00100000:1.0:1782241158.409570:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1782241158.409571:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241158.409584:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139916032:12345-0@lo:400: 00000100:00100000:3.0:1782241158.409628:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139916288:0@lo:400: 00000100:00100000:1.0:1782241158.409657:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139916032:12345-0@lo:400: Request processed in 74us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241158.409666:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1782241158.409709:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139916416 00000100:00100000:1.0:1782241158.409712:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139916416 00000100:00100000:1.0:1782241158.409740:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782241158.409747:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139916416:12345-0@lo:400: 00000100:00100000:1.0:1782241158.409807:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139916416:12345-0@lo:400: Request processed in 60us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241158.409816:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782241158.409831:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139916672:0@lo:400: 00000100:00100000:1.0:1782241158.409845:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139917056 00000100:00100000:1.0:1782241158.409850:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139917056 00000100:00100000:0.0:1782241158.409871:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241158.409892:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139917568 00000100:00100000:1.0:1782241158.409897:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139917568 00000100:00100000:0.0:1782241158.409909:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815139917184:0@lo:400: 00000100:00100000:1.0:1782241158.409919:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139916928 00000100:00100000:1.0:1782241158.409923:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139916928 00000100:00100000:0.0:1782241158.409935:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241158.409974:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139917696:0@lo:13: 00000100:00100000:0.0:1782241158.410001:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241158.410043:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139916544 00000100:00100000:2.0:1782241158.410078:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139917440 00000100:00100000:2.0:1782241158.410084:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139917440 00000100:00100000:2.0:1782241158.410110:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782241158.410216:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782241158.410224:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139917568:12345-0@lo:400: 00000100:00100000:1.0:1782241158.410284:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139917568:12345-0@lo:400: Request processed in 61us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241158.410300:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782241158.410315:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782241158.410321:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139917440:12345-0@lo:400: 00000100:00100000:1.0:1782241158.410351:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139917440:12345-0@lo:400: Request processed in 30us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241158.410357:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782241158.410369:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782241158.410628:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241158.410713:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139917056:12345-0@lo:400: 00000100:00100000:1.0:1782241158.410777:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139916928:12345-0@lo:400: 00000100:00100000:3.0:1782241158.410840:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815139916800:0@lo:400: 00000100:00100000:2.0:1782241158.410869:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139917056:12345-0@lo:400: Request processed in 751us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241158.410888:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782241158.410930:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139916544 00000100:00100000:0.0:1782241158.410969:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139916288 00000100:00100000:0.0:1782241158.410974:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139916288 00000100:00100000:0.0:1782241158.410990:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782241158.410998:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139916544:12345-0@lo:400: 00000100:00100000:2.0:1782241158.411015:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139916032:0@lo:400: 00010000:00080000:2.0:1782241158.411038:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793c000 x1868815139917056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241158.411056:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139917056:0@lo:400: 00000100:00100000:0.0:1782241158.411142:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139916544:12345-0@lo:400: Request processed in 51us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241158.411152:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1782241158.411160:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793e300 x1868815139917568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241158.411170:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782241158.411175:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139917568:0@lo:400: 00000100:00100000:0.0:1782241158.411180:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139916288:12345-0@lo:400: 00000100:00100000:3.0:1782241158.411402:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241158.411679:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139916544:0@lo:400: 00000100:00080000:2.0:1782241158.411796:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782241158.411802:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241158.411818:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139916672 00000100:00100000:2.0:1782241158.411824:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139916672 00000100:00100000:1.0:1782241158.412045:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139916928:12345-0@lo:400: Request processed in 1668us (2526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241158.412055:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782241158.412067:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815139917312:0@lo:400: 00000100:00100000:3.0:1782241158.412132:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241158.412133:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139917184 00000100:00100000:2.0:1782241158.412138:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139917184 00000100:00100000:2.0:1782241158.412164:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139916800 00000100:00100000:2.0:1782241158.412167:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139916800 00000100:00100000:2.0:1782241158.412182:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139917312 00000100:00100000:2.0:1782241158.412184:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139917312 00000100:00100000:2.0:1782241158.412202:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782241158.412209:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139916672:12345-0@lo:400: 00000100:00100000:1.0:1782241158.412397:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1782241158.412407:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1782241158.412497:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139916416:0@lo:400: 00010000:00080000:3.0:1782241158.412515:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793ea00 x1868815139916928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241158.412527:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139916928:0@lo:400: 00010000:00080000:3.0:1782241158.412542:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793ce00 x1868815139917440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241158.412551:0:3639:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1782241158.412566:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139917440:0@lo:400: 00000100:00100000:1.0:1782241158.412582:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1782241158.412595:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782241158.412604:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815139917184:12345-0@lo:400: 00000100:00080000:3.0:1782241158.412619:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782241158.412625:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241158.412688:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139916672:12345-0@lo:400: Request processed in 478us (2816us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241158.412696:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782241158.412709:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782241158.412715:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782241158.412729:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815139916800:12345-0@lo:400: 00000100:00100000:1.0:1782241158.412874:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815139917184:12345-0@lo:400: Request processed in 271us (2938us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241158.412881:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782241158.412893:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1782241158.412899:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782241158.412904:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815139917312:12345-0@lo:400: 00000100:00100000:2.0:1782241158.413046:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815139916800:12345-0@lo:400: Request processed in 317us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241158.413053:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782241158.413162:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139917696 00000100:00100000:2.0:1782241158.413168:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139917696 00000100:00100000:2.0:1782241158.413202:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782241158.413209:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139917696:12345-0@lo:13: 00000100:00100000:1.0:1782241158.413369:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815139917312:12345-0@lo:400: Request processed in 464us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241158.413376:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782241158.414575:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139916288:12345-0@lo:400: Request processed in 3387us (3936us total) trans 0 rc 0/0 00002000:00000024:2.0:1782241158.414584:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241158.414671:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139917696:12345-0@lo:13: Request processed in 1461us (4667us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241158.414680:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782241158.414806:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1782241158.414862:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793c380 x1868815139917696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241158.414889:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139917696:0@lo:13: 00000100:00100000:0.0:1782241158.414907:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139916672:0@lo:400: 00000100:00100000:0.0:1782241158.414943:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815139917184:0@lo:400: 00000100:00100000:3.0:1782241158.415477:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139916288:0@lo:400: 00010000:00080000:2.0:1782241158.415574:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793fb80 x1868815139916800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241158.415587:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815139916800:0@lo:400: 00010000:00080000:2.0:1782241158.415602:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793d180 x1868815139917312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241158.415612:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815139917312:0@lo:400: 00010000:00010000:3.0:1782241158.789023:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241158.917556:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139917824:0@lo:13: 00000100:00100000:0.0:1782241158.917654:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241158.917804:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139917824 00000100:00100000:0.0:1782241158.917814:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139917824 00000100:00100000:0.0:1782241158.917876:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782241158.917887:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139917824:12345-0@lo:13: 00002000:00000024:0.0:1782241158.917919:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241158.917975:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139917824:12345-0@lo:13: Request processed in 89us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241158.917983:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1782241158.918037:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793d880 x1868815139917824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241158.918060:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139917824:0@lo:13: 00000100:00100000:3.0:1782241158.918632:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139917952:0@lo:41: 00000100:00100000:3.0:1782241158.918681:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241158.918728:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139917952 00000100:00100000:3.0:1782241158.918733:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139917952 00000100:00100000:3.0:1782241158.918791:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782241158.918801:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139917952:12345-0@lo:41: 00000004:00000024:3.0:1782241158.918836:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782241158.918893:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139917952:12345-0@lo:41: Request processed in 94us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241158.918901:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782241158.918938:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139917952:0@lo:41: 00000001:00100000:3.0:1782241158.924580:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000001:00100000:0.0:1782241158.924662:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000100:00100000:0.0:1782241159.074069:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241159.074184:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241159.078798:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119946240 00000100:00100000:1.0:1782241159.078829:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119946240 00000100:00100000:1.0:1782241159.078936:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:1.0:1782241159.078949:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2396:x1868815119946240:12345-192.168.204.58@tcp:400: 00000100:00100000:1.0:1782241159.079048:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2396:x1868815119946240:12345-192.168.204.58@tcp:400: Request processed in 103us (4864us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241159.079056:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00080000:3.0:1782241159.082148:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241159.082432:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241159.082530:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119945984 00000100:00100000:3.0:1782241159.082541:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241159.082544:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119945984 00000100:00100000:3.0:1782241159.082587:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00080000:2.0:1782241159.082595:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782241159.082626:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119946112 00000100:00100000:3.0:1782241159.082640:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119946112 00000100:00100000:2.0:1782241159.082662:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 53 00000100:00100000:2.0:1782241159.082677:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2396:x1868815119945984:12345-192.168.204.58@tcp:400: 00000100:00100000:3.0:1782241159.082686:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 54 00000100:00100000:3.0:1782241159.082697:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815119946112:12345-192.168.204.58@tcp:400: 00000100:00100000:2.0:1782241159.082790:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2396:x1868815119945984:12345-192.168.204.58@tcp:400: Request processed in 116us (8736us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241159.082808:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 53 00000100:00100000:3.0:1782241159.083439:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815119946112:12345-192.168.204.58@tcp:400: Request processed in 741us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241159.083447:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 54 00000100:00100000:3.0:1782241159.083478:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119946368 00000100:00100000:3.0:1782241159.083483:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119946368 00000100:00100000:3.0:1782241159.083523:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:3.0:1782241159.083532:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815119946368:12345-192.168.204.58@tcp:400: 00000100:00080000:2.0:1782241159.083544:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782241159.083550:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782241159.086851:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815119946368:12345-192.168.204.58@tcp:400: Request processed in 1621us (2564us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241159.086874:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:3.0:1782241159.086958:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119945856 00000100:00100000:3.0:1782241159.086969:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119945856 00000100:00100000:3.0:1782241159.087025:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 199 00000100:00100000:3.0:1782241159.087034:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2397:x1868815119945856:12345-192.168.204.58@tcp:400: 00000100:00100000:3.0:1782241159.087122:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2397:x1868815119945856:12345-192.168.204.58@tcp:400: Request processed in 88us (4699us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241159.087129:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 199 00000001:02000400:2.0:1782241159.133279:0:10177:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1782241159.813102:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782241159.953892:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000100:00100000:3.0:1782241160.452987:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241160.453013:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139918080:0@lo:13: 00000100:00100000:3.0:1782241160.453080:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241160.453144:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139918080 00000100:00100000:3.0:1782241160.453151:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139918080 00000100:00100000:3.0:1782241160.453207:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782241160.453218:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139918080:12345-0@lo:13: 00002000:00000024:3.0:1782241160.453247:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241160.453293:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139918080:12345-0@lo:13: Request processed in 77us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241160.453300:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1782241160.453320:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241160.453784:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139918208:0@lo:13: 00000100:00100000:0.0:1782241160.453966:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1782241160.454849:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4789ed80 x1868815139918080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241160.454880:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139918080:0@lo:13: 00000100:00100000:3.0:1782241160.454914:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139918208 00000100:00100000:3.0:1782241160.454920:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139918208 00000100:00100000:3.0:1782241160.454967:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782241160.454977:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139918208:12345-0@lo:13: 00002000:00000024:3.0:1782241160.454997:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241160.455056:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139918208:12345-0@lo:13: Request processed in 80us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241160.455064:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1782241160.455096:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782241160.455123:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793ca80 x1868815139918208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241160.455138:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139918208:0@lo:13: 00010000:00010000:0.0:1782241160.837262:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241161.863837:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241162.501173:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139918336:0@lo:41: 00000100:00100000:0.0:1782241162.501279:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241162.501681:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139918336 00000100:00100000:3.0:1782241162.501692:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139918336 00000100:00100000:3.0:1782241162.501794:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782241162.501805:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139918336:12345-0@lo:41: 00000004:00000024:3.0:1782241162.502025:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1782241162.502892:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139918336:12345-0@lo:41: Request processed in 1083us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241162.502904:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782241162.510000:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139918336:0@lo:41: 00000020:00000080:3.0:1782241162.793669:0:10324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec1115a60 20000000:00000080:3.0:1782241162.793698:0:10324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff890d46b19000 uarg=0000000000000000 20000000:01000000:3.0:1782241162.794035:0:10324:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1782241162.794038:0:10324:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1782241162.794042:0:10324:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1782241162.794049:0:10324:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1782241162.794057:0:10324:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1782241162.794145:0:10324:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782241162.794149:0:10324:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782241162.794643:0:10325:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1782241162.794946:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1782241162.794978:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1782241162.794993:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1782241162.795005:0:10324:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782241162.795007:0:10324:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782241162.805417:0:10326:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1782241162.806004:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1782241162.806046:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1782241162.806065:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1782241162.806078:0:10324:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1782241162.806081:0:10324:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1782241162.806544:0:10327:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1782241162.806735:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1782241162.806791:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1782241162.806811:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1782241162.806823:0:10324:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1782241162.806825:0:10324:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782241162.807164:0:10328:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1782241162.807318:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1782241162.807350:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1782241162.807365:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1782241162.807377:0:10324:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1782241162.807379:0:10324:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782241162.818907:0:10329:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1782241162.819463:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1782241162.819505:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1782241162.819525:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:3.0:1782241162.819549:0:10324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782241162.819574:0:10324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e196ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.819598:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4b860600/0xc9959f2fb1e19588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19581 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.819618:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4b861400/0xc9959f2fb1e195b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e195ab expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.819627:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e40031200/0xc9959f2fb1e195f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e195ea expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.819635:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e195ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e195f8 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.819642:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1960d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19606 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.819650:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e19629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19622 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.819658:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e19653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1964c expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.819665:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1966f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19668 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.819673:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e19692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1968b expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.819685:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e82056c00/0xc9959f2fb1e196a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fa5 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.819693:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e196ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fac expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.819716:0:10324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e196ed lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.823929:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e196ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fac expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.823958:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e196ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fac expref: 9 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241162.823982:0:10324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139918464:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241162.824191:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e82056c00/0xc9959f2fb1e196a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fa5 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.824201:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e82056c00/0xc9959f2fb1e196a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fa5 expref: 9 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241162.824236:0:10324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47857480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139918592:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241162.824275:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e19692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1968b expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.824285:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e19692 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1968b expref: 23 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241162.824296:0:10324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47857800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139918720:0@lo:104: 00000100:00100000:2.0:1782241162.824359:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241162.824431:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1966f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19668 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.824440:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1966f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19668 expref: 23 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241162.824449:0:10324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47854700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139918848:0@lo:104: 00000100:00100000:2.0:1782241162.824472:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241162.824578:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e19653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1964c expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.824587:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e19653 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1964c expref: 23 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241162.824595:0:10324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47855880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139918976:0@lo:104: 00000100:00100000:2.0:1782241162.824619:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241162.833008:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241162.833054:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241162.833104:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119946496 00000100:00100000:3.0:1782241162.833116:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119946496 00010000:00010000:3.0:1782241162.833177:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e196ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fac expref: 10 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241162.833210:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119946624 00000100:00100000:3.0:1782241162.833213:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119946624 00010000:00010000:3.0:1782241162.833227:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e82056c00/0xc9959f2fb1e196a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fa5 expref: 11 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241162.833252:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:3.0:1782241162.833262:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e477c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:2398:x1868815119946496:12345-192.168.204.58@tcp:103: 00010000:00010000:3.0:1782241162.833283:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241162.833290:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e196ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fac expref: 11 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.833305:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e196ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fac expref: 11 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.833342:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241162.833407:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e477c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:2398:x1868815119946496:12345-192.168.204.58@tcp:103: Request processed in 146us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241162.833415:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 24 00010000:00010000:2.0:1782241162.833443:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e19629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19622 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.833466:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e19629 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19622 expref: 23 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241162.833482:0:10324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47856a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139919104:0@lo:104: 00000100:00100000:3.0:1782241162.833486:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:3.0:1782241162.833492:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2398:x1868815119946624:12345-192.168.204.58@tcp:103: 00010000:00010000:3.0:1782241162.833499:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241162.833504:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e82056c00/0xc9959f2fb1e196a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fa5 expref: 10 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.833513:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e82056c00/0xc9959f2fb1e196a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fa5 expref: 10 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.833524:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241162.833525:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241162.833541:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2398:x1868815119946624:12345-192.168.204.58@tcp:103: Request processed in 48us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241162.833547:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:0.0:1782241162.834047:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139918720 00000100:00100000:0.0:1782241162.834055:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139918720 00000100:00100000:0.0:1782241162.834094:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139918848 00000100:00100000:0.0:1782241162.834098:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139918848 00000100:00100000:0.0:1782241162.834110:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139918976 00000100:00100000:0.0:1782241162.834113:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139918976 00000100:00100000:0.0:1782241162.834125:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782241162.834133:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47854380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+5:10324:x1868815139918720:12345-0@lo:104: 00010000:00010000:0.0:1782241162.834148:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1968b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19692 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.834231:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782241162.834237:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47854380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+5:10324:x1868815139918720:12345-0@lo:104: Request processed in 106us (9879us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241162.834243:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782241162.834259:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782241162.834265:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47856300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:10324:x1868815139918848:12345-0@lo:104: 00010000:00010000:0.0:1782241162.834273:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e19668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1966f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.834343:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782241162.834348:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47856300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:10324:x1868815139918848:12345-0@lo:104: Request processed in 84us (9876us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241162.834354:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782241162.834367:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782241162.834373:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:10324:x1868815139918976:12345-0@lo:104: 00010000:00010000:0.0:1782241162.834381:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1964c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.834419:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782241162.834424:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:10324:x1868815139918976:12345-0@lo:104: Request processed in 53us (9805us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241162.834429:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1782241162.834464:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782241162.834472:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1968b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19692 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.834473:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241162.834479:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e19668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1966f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.834480:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d000 already unused, calling callback (ffffffffc12aac20) 00010000:00010000:3.0:1782241162.834485:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d600 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:0.0:1782241162.834485:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1968b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e19692 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241162.834489:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e19668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1966f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.834496:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e19668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1966f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.834496:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1968b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e19692 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241162.834504:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1968b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e19692 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241162.834511:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:3.0:1782241162.834512:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e19668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1966f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241162.834518:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782241162.838713:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1968b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19692 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.838736:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782241162.838803:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1968b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19692 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.838813:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164d000/0xc9959f2fb1e1968b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19692 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.838833:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241162.838838:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1964c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.838846:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c800 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:0.0:1782241162.838850:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1964c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e19653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.838860:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1964c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e19653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241162.838869:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1964c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e19653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241162.838875:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241162.838883:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e19668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1966f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.838890:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1964c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.838896:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782241162.838901:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1964c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.838908:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782241162.838918:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164c800/0xc9959f2fb1e1964c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19653 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.838923:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e19668 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1966f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.838928:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241162.838929:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e19668 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1966f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.838930:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241162.838932:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241162.838939:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241162.838940:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241162.838940:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241162.838942:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241162.838964:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139919488:0@lo:103: 00000100:00100000:0.0:1782241162.839053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241162.839135:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782241162.839142:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139919232:0@lo:103: 00000100:00100000:0.0:1782241162.839167:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241162.839195:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241162.839204:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139919360:0@lo:103: 00000100:00100000:0.0:1782241162.839228:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241162.839675:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1960d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19606 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.839692:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1960d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19606 expref: 23 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241162.839706:0:10324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4684df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139919616:0@lo:104: 00010000:00010000:2.0:1782241162.839797:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e195ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e195f8 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.839805:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e195ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e195f8 expref: 23 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241162.839814:0:10324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139919744:0@lo:104: 00010000:00010000:2.0:1782241162.839843:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e40031200/0xc9959f2fb1e195f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e195ea expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.839850:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e40031200/0xc9959f2fb1e195f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e195ea expref: 23 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241162.839856:0:10324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a27100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139919872:0@lo:104: 00010000:00010000:2.0:1782241162.839884:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4b861400/0xc9959f2fb1e195b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e195ab expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.839901:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e4b861400/0xc9959f2fb1e195b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e195ab expref: 23 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241162.839909:0:10324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a26680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139920000:0@lo:104: 00010000:00010000:2.0:1782241162.839932:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4b860600/0xc9959f2fb1e19588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19581 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.839939:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e4b860600/0xc9959f2fb1e19588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19581 expref: 23 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241162.839947:0:10324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a25500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139920128:0@lo:104: 00000100:00100000:2.0:1782241162.839962:0:10324:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f8f900 going to sleep for 11 seconds 00010000:00010000:2.0:1782241162.839999:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b860200/0xc9959f2fb1e196ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fac expref: 9 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241162.840013:0:10324:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139918464:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241162.840028:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e82056c00/0xc9959f2fb1e196a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fa5 expref: 8 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241162.840038:0:10324:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47857480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139918592:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241162.840050:0:10324:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47857800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139918720:0@lo:104: 00000100:00100000:2.0:1782241162.840059:0:10324:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47854700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139918848:0@lo:104: 00000100:00100000:2.0:1782241162.840067:0:10324:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47855880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139918976:0@lo:104: 00000100:00100000:1.0:1782241162.840167:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782241162.840194:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241162.840229:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241162.840239:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241162.840248:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241162.840258:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241162.840282:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139919104 00000100:00100000:1.0:1782241162.840289:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139919104 00000100:00100000:1.0:1782241162.840347:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139919616 00000100:00100000:1.0:1782241162.840350:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139919616 00000100:00100000:1.0:1782241162.840361:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139919744 00000100:00100000:1.0:1782241162.840363:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139919744 00000100:00100000:1.0:1782241162.840371:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139919872 00000100:00100000:1.0:1782241162.840373:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139919872 00000100:00100000:1.0:1782241162.840381:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139920000 00000100:00100000:1.0:1782241162.840383:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139920000 00000100:00100000:1.0:1782241162.840390:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139920128 00000100:00100000:1.0:1782241162.840392:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139920128 00000100:00100000:1.0:1782241162.840405:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782241162.840415:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77923450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+8:10324:x1868815139919104:12345-0@lo:104: 00010000:00010000:1.0:1782241162.840429:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164da00/0xc9959f2fb1e19622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19629 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.840486:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782241162.840501:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77923450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+8:10324:x1868815139919104:12345-0@lo:104: Request processed in 88us (6976us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241162.840509:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782241162.840558:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782241162.840564:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+7:10324:x1868815139919616:12345-0@lo:104: 00010000:00010000:1.0:1782241162.840573:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e40030600/0xc9959f2fb1e19606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1960d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.840607:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782241162.840612:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+7:10324:x1868815139919616:12345-0@lo:104: Request processed in 48us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241162.840617:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782241162.840630:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782241162.840637:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+6:10324:x1868815139919744:12345-0@lo:104: 00010000:00010000:1.0:1782241162.840644:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e195f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e195ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.840679:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782241162.840683:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+6:10324:x1868815139919744:12345-0@lo:104: Request processed in 48us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241162.840689:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782241162.840700:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782241162.840706:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+5:10324:x1868815139919872:12345-0@lo:104: 00010000:00010000:1.0:1782241162.840713:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e195ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e195f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.840785:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1782241162.840796:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+5:10324:x1868815139919872:12345-0@lo:104: Request processed in 90us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241162.840803:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782241162.840816:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782241162.840822:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:10324:x1868815139920000:12345-0@lo:104: 00010000:00010000:1.0:1782241162.840829:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e195ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e195b2 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.840857:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1782241162.840863:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:10324:x1868815139920000:12345-0@lo:104: Request processed in 42us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241162.840869:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782241162.840882:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782241162.840889:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:10324:x1868815139920128:12345-0@lo:104: 00010000:00010000:1.0:1782241162.840896:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e19581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19588 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.840924:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1782241162.840930:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:10324:x1868815139920128:12345-0@lo:104: Request processed in 42us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241162.840935:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1782241162.840955:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1782241162.840963:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164da00/0xc9959f2fb1e19622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19629 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.840972:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164da00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241162.840976:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164da00/0xc9959f2fb1e19622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e19629 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.840998:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164da00/0xc9959f2fb1e19622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e19629 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241162.841006:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164da00/0xc9959f2fb1e19622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e19629 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241162.841012:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782241162.841046:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164da00/0xc9959f2fb1e19622 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19629 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841054:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241162.841075:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164da00/0xc9959f2fb1e19622 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19629 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841083:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164da00/0xc9959f2fb1e19622 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19629 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841097:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1782241162.841101:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e40030600/0xc9959f2fb1e19606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1960d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841106:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40030600 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241162.841109:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e40030600/0xc9959f2fb1e19606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1960d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841115:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e40030600/0xc9959f2fb1e19606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1960d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241162.841122:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e40030600/0xc9959f2fb1e19606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1960d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241162.841134:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782241162.841150:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e40030600/0xc9959f2fb1e19606 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1960d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841156:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241162.841170:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e40030600/0xc9959f2fb1e19606 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1960d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841178:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e40030600/0xc9959f2fb1e19606 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1960d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841190:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1782241162.841193:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e195f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e195ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841200:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861a00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241162.841203:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e195f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e195ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841210:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e195f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e195ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241162.841216:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e195f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e195ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241162.841222:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782241162.841236:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e195f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e195ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841242:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241162.841255:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e195f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e195ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841262:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e195f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e195ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841273:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782241162.841277:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e195ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e195f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841284:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860a00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241162.841287:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e195ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e195f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841294:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e195ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e195f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241162.841301:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e195ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e195f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241162.841306:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782241162.841319:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e195ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e195f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841338:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241162.841343:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e195ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e195f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841350:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b860a00/0xc9959f2fb1e195ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e195f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841360:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782241162.841369:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e195ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e195b2 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841376:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40030200 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241162.841379:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e195ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e195b2 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841387:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e195ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e195b2 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241162.841394:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e195ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e195b2 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241162.841400:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782241162.841416:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e195ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e195b2 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841422:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241162.841427:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e195ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e195b2 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841433:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e40030200/0xc9959f2fb1e195ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e195b2 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841443:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241162.841446:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e19581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19588 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841453:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c200 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241162.841455:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e19581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e19588 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841474:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e19581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e19588 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241162.841480:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e19581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e19588 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241162.841486:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782241162.841502:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e19581 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19588 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841509:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241162.841513:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e19581 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19588 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841520:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164c200/0xc9959f2fb1e19581 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19588 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241162.841536:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241162.841538:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241162.841540:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241162.841558:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139920640:0@lo:103: 00000100:00100000:1.0:1782241162.841605:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241162.841730:0:10324:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47856a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139919104:0@lo:104: 00000100:00100000:2.0:1782241162.841743:0:10324:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4684df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139919616:0@lo:104: 00000100:00100000:2.0:1782241162.841781:0:10324:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139919744:0@lo:104: 00000100:00100000:2.0:1782241162.841789:0:10324:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a27100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139919872:0@lo:104: 00000100:00100000:2.0:1782241162.841796:0:10324:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a26680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139920000:0@lo:104: 00000100:00100000:2.0:1782241162.841803:0:10324:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a25500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1868815139920128:0@lo:104: 00010000:00010000:2.0:1782241162.841858:0:10324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e196ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241162.841913:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139920512:0@lo:103: 00010000:00010000:2.0:1782241162.841946:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241162.841957:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139920256:0@lo:103: 00010000:00010000:2.0:1782241162.841988:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241162.842008:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241162.843842:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139919488 00000100:00100000:3.0:1782241162.843860:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139919488 00010000:00010000:3.0:1782241162.843927:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e19653 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1964c expref: 24 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241162.844575:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139919232 00000100:00100000:3.0:1782241162.844583:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139919232 00010000:00010000:3.0:1782241162.844610:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e19692 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1968b expref: 25 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241162.844631:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139919360 00000100:00100000:3.0:1782241162.844635:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139919360 00010000:00010000:3.0:1782241162.844647:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1966f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19668 expref: 26 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241162.844663:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782241162.844673:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+26:3640:x1868815139919488:12345-0@lo:103: 00010000:00010000:3.0:1782241162.844693:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241162.844699:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e19653 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1964c expref: 26 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.844731:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e19653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1964c expref: 26 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.844863:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e19653 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1964c expref: 26 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.844886:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241162.845240:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+25:3640:x1868815139919488:12345-0@lo:103: Request processed in 566us (6185us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241162.845249:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782241162.845275:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782241162.845283:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139919232:12345-0@lo:103: 00010000:00010000:3.0:1782241162.845293:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241162.845299:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e19692 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1968b expref: 24 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.845310:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e19692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1968b expref: 24 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.845336:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e19692 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1968b expref: 24 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.845347:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241162.845374:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+23:3640:x1868815139919232:12345-0@lo:103: Request processed in 92us (6206us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241162.845381:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782241162.845393:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782241162.845399:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+22:3638:x1868815139919360:12345-0@lo:103: 00010000:00010000:3.0:1782241162.845414:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241162.845420:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1966f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19668 expref: 22 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.845428:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1966f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19668 expref: 22 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.845437:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1966f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19668 expref: 22 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.845445:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241162.845476:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+21:3638:x1868815139919360:12345-0@lo:103: Request processed in 78us (6247us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241162.845483:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782241162.848720:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139920384:0@lo:103: 00000100:00100000:1.0:1782241162.848850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241162.848894:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139920896:0@lo:103: 00000100:00100000:3.0:1782241162.848907:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139920640 00000100:00100000:3.0:1782241162.848918:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139920640 00000100:00100000:1.0:1782241162.848920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241162.848966:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782241162.848967:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e40031200/0xc9959f2fb1e195f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e195ea expref: 21 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241162.849003:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139920384 00000100:00100000:3.0:1782241162.849006:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139920384 00000100:00100000:1.0:1782241162.849016:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139920768:0@lo:103: 00010000:00010000:3.0:1782241162.849017:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1960d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19606 expref: 22 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241162.849028:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139920896 00000100:00100000:3.0:1782241162.849030:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139920896 00010000:00010000:3.0:1782241162.849039:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4b860600/0xc9959f2fb1e19588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19581 expref: 23 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241162.849048:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139920256 00000100:00100000:3.0:1782241162.849050:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139920256 00000100:00100000:1.0:1782241162.849056:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782241162.849069:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e19629 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19622 expref: 24 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241162.849080:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139920768 00000100:00100000:3.0:1782241162.849082:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139920768 00010000:00010000:3.0:1782241162.849093:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4b861400/0xc9959f2fb1e195b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e195ab expref: 25 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241162.849093:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139919360:0@lo:103: 00000100:00100000:3.0:1782241162.849106:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782241162.849115:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+25:3637:x1868815139920640:12345-0@lo:103: 00000100:00100000:1.0:1782241162.849128:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241162.849154:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139919232:0@lo:103: 00000100:00100000:1.0:1782241162.849165:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139919488:0@lo:103: 00000100:00100000:0.0:1782241162.849250:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782241162.849262:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1782241162.849265:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241162.849272:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e40031200/0xc9959f2fb1e195f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e195ea expref: 25 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.849284:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e40031200/0xc9959f2fb1e195f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e195ea expref: 25 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.849306:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e40031200/0xc9959f2fb1e195f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e195ea expref: 25 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.849345:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241162.849401:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815139920640:12345-0@lo:103: Request processed in 285us (7794us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241162.849408:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782241162.849428:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139920512 00000100:00100000:3.0:1782241162.849431:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139920512 00010000:00010000:3.0:1782241162.849444:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e195ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e195f8 expref: 24 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241162.849457:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782241162.849464:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139920384:12345-0@lo:103: 00010000:00010000:3.0:1782241162.849480:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782241162.849480:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1782241162.849485:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1960d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19606 expref: 24 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241162.849487:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139920896:12345-0@lo:103: 00010000:00010000:3.0:1782241162.849494:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1960d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19606 expref: 24 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.849495:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241162.849500:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4b860600/0xc9959f2fb1e19588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19581 expref: 24 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.849515:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1960d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19606 expref: 24 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241162.849628:0:10330:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1782241162.849634:0:10330:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:2.0:1782241162.851431:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1782241162.851465:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782241162.851482:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62797b42-772f-434f-be35-dfdfcff291e0+23:3638:x1868815139920256:12345-0@lo:103: 00010000:00010000:2.0:1782241162.851511:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241162.851522:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e19629 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19622 expref: 23 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241162.851653:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47856680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139920640:0@lo:103: 00010000:00010000:0.0:1782241162.855421:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4b860600/0xc9959f2fb1e19588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19581 expref: 23 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.855465:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b860600/0xc9959f2fb1e19588 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19581 expref: 23 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.855514:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782241162.856346:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241162.856480:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+22:3639:x1868815139920896:12345-0@lo:103: Request processed in 6989us (7553us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241162.856497:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782241162.856509:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+22:3639:x1868815139920384:12345-0@lo:103: Request processed in 7042us (7656us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241162.856519:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782241162.856549:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782241162.856565:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+20:3638:x1868815139920768:12345-0@lo:103: 00010000:00010000:0.0:1782241162.856589:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241162.856598:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4b861400/0xc9959f2fb1e195b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e195ab expref: 20 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.856609:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4b861400/0xc9959f2fb1e195b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e195ab expref: 20 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.856623:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b861400/0xc9959f2fb1e195b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e195ab expref: 20 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.856636:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241162.856678:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+19:3638:x1868815139920768:12345-0@lo:103: Request processed in 119us (7620us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241162.856685:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782241162.856703:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782241162.856711:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e477c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+18:3640:x1868815139920512:12345-0@lo:103: 00010000:00010000:0.0:1782241162.856720:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241162.856725:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e195ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e195f8 expref: 18 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.856734:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e195ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e195f8 expref: 18 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.856775:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e40030a00/0xc9959f2fb1e195ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e195f8 expref: 18 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241162.856789:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241162.856829:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e477c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+17:3640:x1868815139920512:12345-0@lo:103: Request processed in 119us (7699us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241162.856837:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782241162.856870:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139920512:0@lo:103: 00000100:00100000:0.0:1782241162.856879:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139920768:0@lo:103: 00010000:00010000:2.0:1782241162.860483:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e19629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19622 expref: 16 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.860524:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e19629 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19622 expref: 16 pid: 6503 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.860548:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e196ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.860587:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e196ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241162.860813:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139920896:0@lo:103: 00000100:00100000:2.0:1782241162.860952:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139920384:0@lo:103: 00010000:00010000:3.0:1782241162.861233:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e196ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.861245:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e196ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.861252:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e196ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.861261:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e196ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.861268:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e47181c00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241162.861273:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e196ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.861296:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e196ed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.861333:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e196ed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241162.861347:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241162.861455:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:62797b42-772f-434f-be35-dfdfcff291e0+15:3638:x1868815139920256:12345-0@lo:103: Request processed in 9978us (12485us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241162.861468:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1782241162.861586:0:10324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e196ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.861595:0:10324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e196ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241162.861602:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e47181c00/0xc9959f2fb1e196ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241162.862663:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139920256:0@lo:103: 00010000:00010000:1.0:1782241162.887985:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241163.525416:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139921024:0@lo:13: 00000100:00100000:2.0:1782241163.525519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241163.525692:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139921024 00000100:00100000:0.0:1782241163.525703:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139921024 00000100:00100000:0.0:1782241163.525808:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782241163.525822:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139921024:12345-0@lo:13: 00002000:00000024:0.0:1782241163.525864:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241163.525937:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139921024:12345-0@lo:13: Request processed in 119us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241163.525945:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782241163.525972:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139921280:0@lo:400: 00000100:00100000:0.0:1782241163.526013:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241163.526049:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815139921792:0@lo:400: 00000100:00100000:0.0:1782241163.526086:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241163.526107:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815139922304:0@lo:400: 00000100:00100000:0.0:1782241163.526131:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241163.526153:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782241163.526160:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139921152:0@lo:400: 00000100:00100000:0.0:1782241163.526206:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241163.526226:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139921664:0@lo:400: 00000100:00100000:0.0:1782241163.526249:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241163.526270:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139922176:0@lo:400: 00000100:00100000:0.0:1782241163.526295:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241163.526332:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139921280 00000100:00100000:0.0:1782241163.526337:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139921280 00000100:00100000:0.0:1782241163.526374:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782241163.526383:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139921280:12345-0@lo:400: 00000100:00100000:0.0:1782241163.526429:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139921280:12345-0@lo:400: Request processed in 48us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241163.526436:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782241163.526456:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139921792 00000100:00100000:0.0:1782241163.526459:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139921792 00000100:00100000:0.0:1782241163.526481:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139922304 00000100:00100000:0.0:1782241163.526483:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139922304 00000100:00100000:0.0:1782241163.526497:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139921152 00000100:00100000:0.0:1782241163.526500:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139921152 00000100:00100000:0.0:1782241163.526510:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139921664 00000100:00100000:0.0:1782241163.526512:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139921664 00000100:00100000:0.0:1782241163.526523:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139922176 00000100:00100000:0.0:1782241163.526526:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139922176 00000100:00100000:0.0:1782241163.526540:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782241163.526546:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815139921792:12345-0@lo:400: 00000100:00100000:0.0:1782241163.526580:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815139921792:12345-0@lo:400: Request processed in 34us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241163.526587:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782241163.526599:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782241163.526613:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815139922304:12345-0@lo:400: 00000100:00100000:0.0:1782241163.526646:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815139922304:12345-0@lo:400: Request processed in 34us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241163.526653:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782241163.526667:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782241163.526673:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139921152:12345-0@lo:400: 00000100:00100000:0.0:1782241163.526704:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139921152:12345-0@lo:400: Request processed in 31us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241163.526711:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782241163.526722:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782241163.526729:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139921664:12345-0@lo:400: 00000100:00100000:0.0:1782241163.526790:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139921664:12345-0@lo:400: Request processed in 61us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241163.526796:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782241163.526809:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782241163.526817:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139922176:12345-0@lo:400: 00000100:00100000:0.0:1782241163.526850:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139922176:12345-0@lo:400: Request processed in 34us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241163.526857:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782241163.526911:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139921152:0@lo:400: 00000100:00100000:0.0:1782241163.526924:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139921664:0@lo:400: 00000100:00100000:0.0:1782241163.526933:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139922176:0@lo:400: 00010000:00080000:0.0:1782241163.526946:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4789ce00 x1868815139921792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241163.526971:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815139921792:0@lo:400: 00010000:00080000:0.0:1782241163.526985:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4789f480 x1868815139922304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241163.526993:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815139922304:0@lo:400: 00000100:00100000:0.0:1782241163.527005:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139921280:0@lo:400: 00000100:00080000:2.0:1782241163.527624:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782241163.527632:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241163.527635:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782241163.527663:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139921408:0@lo:400: 00000100:00100000:2.0:1782241163.527714:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241163.527778:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139921920:0@lo:400: 00000100:00100000:2.0:1782241163.527810:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241163.527849:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139921536:0@lo:400: 00000100:00100000:2.0:1782241163.527860:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139922432:0@lo:400: 00000100:00100000:3.0:1782241163.527896:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241163.527904:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241163.527926:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139922048:0@lo:400: 00000100:00100000:3.0:1782241163.527952:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241163.527955:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139921920 00000100:00100000:2.0:1782241163.527962:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139921920 00010000:00080000:3.0:1782241163.527987:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793ce00 x1868815139921024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241163.528011:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139921024:0@lo:13: 00000100:00100000:2.0:1782241163.528014:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139922432 00000100:00100000:2.0:1782241163.528029:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139922432 00000100:00100000:3.0:1782241163.528040:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139921536 00000100:00100000:3.0:1782241163.528045:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139921536 00000100:00100000:2.0:1782241163.528060:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139922048 00000100:00100000:2.0:1782241163.528065:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139922048 00000100:00100000:3.0:1782241163.528081:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782241163.528093:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782241163.528094:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139921536:12345-0@lo:400: 00000100:00100000:2.0:1782241163.528107:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139921920:12345-0@lo:400: 00000100:00100000:2.0:1782241163.528158:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139921920:12345-0@lo:400: Request processed in 55us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241163.528166:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782241163.528173:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782241163.528185:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139922432:12345-0@lo:400: 00000100:00100000:2.0:1782241163.528198:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782241163.528209:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139922048:12345-0@lo:400: 00000100:00100000:1.0:1782241163.528242:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139922432:12345-0@lo:400: Request processed in 59us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241163.528259:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139922048:12345-0@lo:400: Request processed in 51us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241163.528260:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782241163.528272:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1782241163.528323:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241163.528327:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241163.528382:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139921408 00000100:00100000:0.0:1782241163.528388:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139921408 00000100:00100000:0.0:1782241163.528421:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782241163.528428:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139921408:12345-0@lo:400: 00000100:00100000:0.0:1782241163.528473:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139921408:12345-0@lo:400: Request processed in 45us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241163.528479:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782241163.528540:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139921408:0@lo:400: 00010000:00080000:0.0:1782241163.528551:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4789e300 x1868815139921920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241163.528560:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139921920:0@lo:400: 00010000:00080000:0.0:1782241163.528570:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4789fb80 x1868815139922432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241163.528579:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139922432:0@lo:400: 00000100:00100000:3.0:1782241163.529271:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139921536:12345-0@lo:400: Request processed in 296us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241163.529283:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782241163.529358:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139921536:0@lo:400: 00010000:00080000:3.0:1782241163.529371:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4789c380 x1868815139922048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241163.529409:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139922048:0@lo:400: 00010000:00010000:2.0:1782241163.909037:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241164.036934:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782241164.036958:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241164.036973:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139922688:0@lo:13: 00000100:00100000:3.0:1782241164.036974:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139922560:0@lo:41: 00000100:00100000:3.0:1782241164.039328:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241164.039446:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139922560 00000100:00100000:1.0:1782241164.039460:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139922560 00000100:00100000:1.0:1782241164.039557:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782241164.039569:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139922560:12345-0@lo:41: 00000004:00000024:1.0:1782241164.039623:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241164.039701:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139922560:12345-0@lo:41: Request processed in 134us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241164.039710:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782241164.039951:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139922560:0@lo:41: 00000100:00100000:0.0:1782241164.043812:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241164.051893:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139922688 00000100:00100000:3.0:1782241164.051917:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139922688 00000100:00100000:3.0:1782241164.052294:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782241164.052319:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139922688:12345-0@lo:13: 00002000:00000024:3.0:1782241164.052360:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241164.053069:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139922688:12345-0@lo:13: Request processed in 752us (9266us total) trans 0 rc 0/0 00010000:00080000:0.0:1782241164.053167:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793e680 x1868815139922688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241164.053197:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782241164.053197:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139922688:0@lo:13: 00000100:00100000:3.0:1782241164.186802:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241164.186859:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241164.186915:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241164.186942:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241164.186982:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119946880 00000100:00100000:3.0:1782241164.186995:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119946880 00000100:00100000:3.0:1782241164.187067:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119947008 00000100:00100000:3.0:1782241164.187070:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119947008 00000100:00100000:3.0:1782241164.187096:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 61 00000100:00100000:1.0:1782241164.187284:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119946752 00000100:00100000:1.0:1782241164.187289:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119946752 00000100:00100000:1.0:1782241164.187335:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 200 00000100:00100000:1.0:1782241164.187344:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+8:2399:x1868815119946752:12345-192.168.204.58@tcp:400: 00000100:00100000:1.0:1782241164.187439:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+8:2399:x1868815119946752:12345-192.168.204.58@tcp:400: Request processed in 96us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241164.187448:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 200 00000100:00080000:1.0:1782241164.187486:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241164.187491:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241164.187724:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 62 00000100:00100000:2.0:1782241164.187737:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119947008:12345-192.168.204.58@tcp:400: 00000100:00100000:2.0:1782241164.187968:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119947008:12345-192.168.204.58@tcp:400: Request processed in 234us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.187976:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 62 00000100:00100000:0.0:1782241164.188215:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119947136 00000100:00100000:0.0:1782241164.188222:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119947136 00000100:00100000:0.0:1782241164.188283:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:0.0:1782241164.188292:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119947136:12345-192.168.204.58@tcp:400: 00000100:00100000:0.0:1782241164.188349:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119947136:12345-192.168.204.58@tcp:400: Request processed in 59us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241164.188355:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00080000:1.0:1782241164.188499:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241164.189255:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119946880:12345-192.168.204.58@tcp:400: 00000100:00100000:3.0:1782241164.192086:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119946880:12345-192.168.204.58@tcp:400: Request processed in 4962us (5326us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241164.193320:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241164.193610:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119947264 00000100:00100000:2.0:1782241164.193623:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119947264 00000100:00100000:2.0:1782241164.193713:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:2.0:1782241164.193737:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119947264:12345-192.168.204.58@tcp:400: 00000100:00100000:2.0:1782241164.193859:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119947264:12345-192.168.204.58@tcp:400: Request processed in 125us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.193867:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:3.0:1782241164.194085:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 61 00000100:00080000:1.0:1782241164.195317:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:2.0:1782241164.423887:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782241164.423900:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e77a72800 from 48 10000000:01000000:2.0:1782241164.423907:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782241164.423980:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.423993:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.424006:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241164.424038:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139922816:0@lo:101: 00000100:00100000:2.0:1782241164.424136:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241164.424243:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f72840 going to sleep for 11 seconds 00000100:00100000:1.0:1782241164.424538:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139922816 00000100:00100000:1.0:1782241164.424549:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139922816 00000100:00100000:1.0:1782241164.424624:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1782241164.424635:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+15:6508:x1868815139922816:12345-0@lo:101: 00010000:00010000:1.0:1782241164.424654:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241164.424671:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e82057e00/0xc9959f2fb1e196fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e196f4 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241164.424699:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e82057e00/0xc9959f2fb1e196fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e196f4 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241164.424710:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e82057e00/0xc9959f2fb1e196fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e196f4 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241164.424733:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e82057e00, rc 0) 00000100:00100000:1.0:1782241164.424820:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139922816:12345-0@lo:101: Request processed in 187us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241164.424851:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1782241164.424978:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a27b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139922816:0@lo:101: 00010000:00010000:3.0:1782241164.424995:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e196fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.425006:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e196fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241164.425080:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139922944:0@lo:501: 00000100:00100000:3.0:1782241164.425113:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241164.425147:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f8f540 going to sleep for 11 seconds 00000100:00100000:1.0:1782241164.425815:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139922944 00000100:00100000:1.0:1782241164.425822:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139922944 00000100:00100000:1.0:1782241164.425873:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1782241164.425882:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139922944:12345-0@lo:501: 00000100:00100000:1.0:1782241164.426065:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139922944:12345-0@lo:501: Request processed in 181us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241164.426076:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1782241164.426174:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139922944:0@lo:501: 00000100:00100000:0.0:1782241164.426219:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139923072:0@lo:503: 00000100:00100000:0.0:1782241164.426275:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241164.426340:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241164.426404:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139923072 00000100:00100000:3.0:1782241164.426408:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139923072 00000100:00100000:3.0:1782241164.426431:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1782241164.426437:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139923072:12345-0@lo:503: 00000100:00100000:3.0:1782241164.426540:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139923072:12345-0@lo:503: Request processed in 102us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241164.426547:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1782241164.426627:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139923072:0@lo:503: 00000100:00100000:1.0:1782241164.427625:0:10344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ece00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10344:1868815139923200:0@lo:502: 00000100:00100000:1.0:1782241164.427684:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241164.427735:0:10344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e7d6180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241164.429831:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139923200 00000100:00100000:3.0:1782241164.429851:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139923200 00000100:00100000:3.0:1782241164.429944:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1782241164.429956:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+16:10344:x1868815139923200:12345-0@lo:502: 00000100:00100000:3.0:1782241164.430205:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+16:10344:x1868815139923200:12345-0@lo:502: Request processed in 250us (2520us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241164.430214:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1782241164.431561:0:10344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ece00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10344:1868815139923200:0@lo:502: 00000100:00100000:1.0:1782241164.431661:0:10344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ece00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10344:1868815139923328:0@lo:502: 00000100:00100000:1.0:1782241164.431734:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241164.431828:0:10344:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e7d6180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241164.432950:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139923328 00000100:00100000:3.0:1782241164.432963:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139923328 00000100:00100000:3.0:1782241164.433042:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1782241164.433054:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:10344:x1868815139923328:12345-0@lo:502: 00000100:00100000:3.0:1782241164.433265:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+16:10344:x1868815139923328:12345-0@lo:502: Request processed in 212us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241164.433273:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1782241164.433432:0:10344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ece00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10344:1868815139923328:0@lo:502: 00000040:00080000:2.0:1782241164.433472:0:10344:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1782241164.433725:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1782241164.433804:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782241164.433819:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e196fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241164.433831:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e196fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241164.433843:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1782241164.433846:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1782241164.433849:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1782241164.433900:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241164.433909:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241164.433920:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241164.433942:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139923456:0@lo:101: 00000100:00100000:0.0:1782241164.433986:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241164.434036:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241164.434182:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139923456 00000100:00100000:2.0:1782241164.434188:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139923456 00000100:00100000:2.0:1782241164.434236:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1782241164.434246:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+16:6508:x1868815139923456:12345-0@lo:101: 00010000:00010000:2.0:1782241164.434259:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241164.434276:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e19709 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19702 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.434317:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e19709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19702 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.434329:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e19709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19702 expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.434352:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861200, rc 0) 00000100:00100000:2.0:1782241164.434397:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139923456:12345-0@lo:101: Request processed in 152us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.434404:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1782241164.434487:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139923456:0@lo:101: 00010000:00010000:0.0:1782241164.434501:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19709 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241164.434511:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19709 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241164.434571:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139923584:0@lo:501: 00000100:00100000:0.0:1782241164.434599:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241164.434638:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241164.435004:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139923584 00000100:00100000:1.0:1782241164.435010:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139923584 00000100:00100000:1.0:1782241164.435051:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1782241164.435060:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139923584:12345-0@lo:501: 00000100:00100000:1.0:1782241164.435207:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139923584:12345-0@lo:501: Request processed in 148us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241164.435214:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1782241164.435314:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139923584:0@lo:501: 00000100:00100000:0.0:1782241164.435348:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139923712:0@lo:503: 00000100:00100000:0.0:1782241164.435397:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241164.435433:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241164.435830:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139923712 00000100:00100000:2.0:1782241164.435836:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139923712 00000100:00100000:2.0:1782241164.435874:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1782241164.435882:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139923712:12345-0@lo:503: 00000100:00100000:2.0:1782241164.435987:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139923712:12345-0@lo:503: Request processed in 105us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.435994:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1782241164.436078:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139923712:0@lo:503: 00000100:00100000:1.0:1782241164.436606:0:10345:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10345:1868815139923840:0@lo:502: 00000100:00100000:1.0:1782241164.436652:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241164.436686:0:10345:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e7d618a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782241164.440550:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139923840 00000100:00100000:2.0:1782241164.440572:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139923840 00000100:00100000:2.0:1782241164.440674:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1782241164.440689:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:10345:x1868815139923840:12345-0@lo:502: 00000100:00100000:2.0:1782241164.440982:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+17:10345:x1868815139923840:12345-0@lo:502: Request processed in 296us (4328us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.440991:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1782241164.441305:0:10345:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10345:1868815139923840:0@lo:502: 00000020:01000000:1.0:1782241164.441355:0:10345:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241164.441368:0:10345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241164.441371:0:10345:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782241164.441379:0:10345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782241164.441424:0:10345:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10345:1868815139923968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241164.441509:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241164.441551:0:10345:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a280c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241164.441694:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139923968 00000100:00100000:3.0:1782241164.441701:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139923968 00000100:00100000:3.0:1782241164.441754:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1782241164.441805:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:10345:x1868815139923968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241164.441908:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:10345:x1868815139923968:12345-0@lo:502:llog_process_th.0 Request processed in 127us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241164.441915:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1782241164.442243:0:10345:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10345:1868815139923968:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782241164.442265:0:10345:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241164.442270:0:10345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241164.442272:0:10345:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782241164.442277:0:10345:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1782241164.442609:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1782241164.442637:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782241164.442649:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19709 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.442662:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19709 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241164.442675:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782241164.442678:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e7d6df800 from 48 10000000:01000000:3.0:1782241164.442681:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782241164.442726:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.442735:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.442745:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241164.442812:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139924096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782241164.442854:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241164.442884:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f8f540 going to sleep for 11 seconds 00000100:00100000:1.0:1782241164.443062:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139924096 00000100:00100000:1.0:1782241164.443068:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139924096 00000100:00100000:1.0:1782241164.443112:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1782241164.443121:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+17:6508:x1868815139924096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241164.443133:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241164.443148:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e82056c00/0xc9959f2fb1e19717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19710 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241164.443175:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e82056c00/0xc9959f2fb1e19717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19710 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241164.443187:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e82056c00/0xc9959f2fb1e19717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19710 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241164.443197:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e82056c00, rc 0) 00000100:00100000:1.0:1782241164.443240:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139924096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241164.443254:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1782241164.443424:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139924096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241164.443439:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19717 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.443450:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19717 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241164.443520:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139924224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241164.443550:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241164.443582:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f8f540 going to sleep for 11 seconds 00000100:00100000:2.0:1782241164.443635:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139924224 00000100:00100000:2.0:1782241164.443641:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139924224 00000100:00100000:2.0:1782241164.443680:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1782241164.443689:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139924224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241164.443893:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139924224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.443901:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1782241164.444613:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139924224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241164.444659:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139924352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241164.444725:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241164.445017:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f8f540 going to sleep for 11 seconds 00000100:00100000:1.0:1782241164.451332:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139924352 00000100:00100000:1.0:1782241164.451356:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139924352 00000100:00100000:1.0:1782241164.451467:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1782241164.451483:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139924352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782241164.451723:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139924352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (7006us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241164.451734:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1782241164.456725:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139924352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241164.458175:0:10346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10346:1868815139924480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241164.458304:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241164.458357:0:10346:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f8f900 going to sleep for 11 seconds 00000100:00100000:0.0:1782241164.458472:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139924480 00000100:00100000:0.0:1782241164.458488:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139924480 00000100:00100000:0.0:1782241164.458551:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1782241164.458561:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:10346:x1868815139924480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241164.458798:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+18:10346:x1868815139924480:12345-0@lo:502:llog_process_th.0 Request processed in 237us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241164.458807:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1782241164.458992:0:10346:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10346:1868815139924480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241164.459044:0:10346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10346:1868815139924608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241164.459086:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241164.459129:0:10346:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f8f900 going to sleep for 11 seconds 00000100:00100000:0.0:1782241164.459235:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139924608 00000100:00100000:0.0:1782241164.459240:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139924608 00000100:00100000:0.0:1782241164.459271:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1782241164.459278:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+18:10346:x1868815139924608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241164.459361:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+18:10346:x1868815139924608:12345-0@lo:502:llog_process_th.0 Request processed in 83us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241164.459368:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1782241164.460913:0:10346:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10346:1868815139924608:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782241164.460966:0:10346:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1782241164.461262:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1782241164.461302:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782241164.461319:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19717 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241164.461332:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19717 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241164.461344:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1782241164.461347:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1782241164.461351:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1782241164.461397:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241164.461406:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241164.461428:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241164.461451:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139924736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782241164.461520:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241164.461578:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241164.462227:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139924736 00000100:00100000:3.0:1782241164.462237:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139924736 00000100:00100000:3.0:1782241164.462354:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1782241164.462366:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+18:6508:x1868815139924736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241164.462388:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241164.462406:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e47180800/0xc9959f2fb1e19725 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1971e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.462439:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e47180800/0xc9959f2fb1e19725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1971e expref: 19 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.462452:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e47180800/0xc9959f2fb1e19725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1971e expref: 19 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.462462:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e47180800, rc 0) 00000100:00100000:3.0:1782241164.462523:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+19:6508:x1868815139924736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241164.462531:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1782241164.462636:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139924736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241164.462654:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19725 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241164.462664:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19725 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241164.462783:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139924864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241164.462818:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241164.468817:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782241164.468959:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139924864 00000100:00100000:1.0:1782241164.468973:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139924864 00000100:00100000:1.0:1782241164.469046:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1782241164.469057:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+19:6508:x1868815139924864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241164.469289:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+19:6508:x1868815139924864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (6470us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241164.469311:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1782241164.471043:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139924864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241164.471144:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139924992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241164.471235:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241164.471309:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782241164.471472:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139924992 00000100:00100000:1.0:1782241164.471482:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139924992 00000100:00100000:1.0:1782241164.471534:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1782241164.471544:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+19:6508:x1868815139924992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782241164.471678:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+19:6508:x1868815139924992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241164.471687:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1782241164.473030:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139924992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241164.478259:0:10347:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10347:1868815139925120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241164.478375:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241164.478442:0:10347:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8900 going to sleep for 11 seconds 00000100:00100000:3.0:1782241164.479771:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139925120 00000100:00100000:3.0:1782241164.479787:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139925120 00000100:00100000:3.0:1782241164.479871:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1782241164.479883:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+19:10347:x1868815139925120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241164.480094:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+19:10347:x1868815139925120:12345-0@lo:502:llog_process_th.0 Request processed in 212us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241164.480110:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1782241164.483035:0:10347:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10347:1868815139925120:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782241164.483114:0:10347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782241164.483131:0:10347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241164.483134:0:10347:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782241164.483139:0:10347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782241164.483190:0:10347:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10347:1868815139925248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241164.483287:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241164.483364:0:10347:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8900 going to sleep for 11 seconds 00000100:00100000:3.0:1782241164.484777:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139925248 00000100:00100000:3.0:1782241164.484793:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139925248 00000100:00100000:3.0:1782241164.484868:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1782241164.484880:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+19:10347:x1868815139925248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241164.485082:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+19:10347:x1868815139925248:12345-0@lo:502:llog_process_th.0 Request processed in 204us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241164.485092:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1782241164.485440:0:10347:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10347:1868815139925248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782241164.485492:0:10347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241164.485503:0:10347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241164.485505:0:10347:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782241164.485510:0:10347:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1782241164.487259:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1782241164.487313:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782241164.487330:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19725 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241164.487361:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19725 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241164.487375:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782241164.487378:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e43609000 from 48 10000000:01000000:1.0:1782241164.487381:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782241164.487432:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241164.487441:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241164.487452:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241164.487486:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139925376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782241164.487571:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241164.487624:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503a93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241164.487818:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139925376 00000100:00100000:3.0:1782241164.487826:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139925376 00000100:00100000:3.0:1782241164.487881:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1782241164.487892:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+19:6508:x1868815139925376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241164.487908:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241164.487924:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e47180e00/0xc9959f2fb1e19733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1972c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.487952:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e47180e00/0xc9959f2fb1e19733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1972c expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.487964:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e47180e00/0xc9959f2fb1e19733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1972c expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.487974:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e47180e00, rc 0) 00000100:00100000:3.0:1782241164.488029:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139925376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241164.488038:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1782241164.488174:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139925376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241164.488192:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19733 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241164.488202:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19733 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241164.488358:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139925504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241164.488392:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241164.488434:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77983b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241164.488595:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139925504 00000100:00100000:3.0:1782241164.488615:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139925504 00000100:00100000:3.0:1782241164.488654:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1782241164.488662:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139925504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241164.488845:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139925504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241164.488853:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1782241164.488930:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139925504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241164.488964:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139925632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241164.489007:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241164.489039:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77983b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782241164.489183:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139925632 00000100:00100000:0.0:1782241164.489189:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139925632 00000100:00100000:0.0:1782241164.489222:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1782241164.489228:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139925632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241164.489357:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139925632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241164.489364:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1782241164.489445:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139925632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782241164.490388:0:10348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10348:1868815139925760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241164.490455:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241164.490499:0:10348:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503a93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241164.490606:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139925760 00000100:00100000:3.0:1782241164.490614:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139925760 00000100:00100000:3.0:1782241164.490662:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1782241164.490671:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+20:10348:x1868815139925760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241164.490829:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+20:10348:x1868815139925760:12345-0@lo:502:llog_process_th.0 Request processed in 157us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241164.490837:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1782241164.491243:0:10348:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10348:1868815139925760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241164.491315:0:10348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10348:1868815139925888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241164.491356:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241164.491389:0:10348:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4b863000 going to sleep for 11 seconds 00000100:00100000:3.0:1782241164.493640:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139925888 00000100:00100000:3.0:1782241164.493657:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139925888 00000100:00100000:3.0:1782241164.493742:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1782241164.493771:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+20:10348:x1868815139925888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241164.493974:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+20:10348:x1868815139925888:12345-0@lo:502:llog_process_th.0 Request processed in 221us (2616us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241164.493983:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1782241164.494304:0:10348:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10348:1868815139925888:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782241164.494361:0:10348:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1782241164.499021:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1782241164.499077:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782241164.499093:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19733 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.499236:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19733 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241164.499250:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1782241164.499253:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1782241164.499257:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1782241164.499329:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.499339:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.499354:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241164.499411:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139926016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782241164.499502:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241164.499564:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77983b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241164.502475:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139926016 00000100:00100000:3.0:1782241164.502496:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139926016 00000100:00100000:3.0:1782241164.502586:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1782241164.502600:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139926016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241164.502625:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241164.502650:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e47181000/0xc9959f2fb1e19741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1973a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.502708:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e47181000/0xc9959f2fb1e19741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1973a expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.502722:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e47181000/0xc9959f2fb1e19741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1973a expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.502733:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e47181000, rc 0) 00000100:00100000:3.0:1782241164.502873:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139926016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 276us (3370us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241164.502881:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1782241164.503012:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139926016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241164.503034:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19741 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.503045:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19741 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241164.503161:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139926144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241164.503202:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241164.503254:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77983b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241164.503854:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139926144 00000100:00100000:3.0:1782241164.503862:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139926144 00000100:00100000:3.0:1782241164.503910:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1782241164.503918:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e49385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139926144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241164.504084:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e49385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139926144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241164.504092:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1782241164.504919:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139926144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241164.504978:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139926272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241164.505046:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241164.505094:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77983b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241164.505191:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139926272 00000100:00100000:3.0:1782241164.505198:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139926272 00000100:00100000:3.0:1782241164.505244:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1782241164.505253:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e438c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139926272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241164.505392:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e438c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139926272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241164.505400:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1782241164.506603:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a26a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139926272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241164.509697:0:10349:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10349:1868815139926400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241164.511412:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241164.511502:0:10349:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8240 going to sleep for 11 seconds 00000100:00100000:3.0:1782241164.511541:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139926400 00000100:00100000:3.0:1782241164.511551:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139926400 00000100:00100000:3.0:1782241164.511647:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1782241164.511657:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e438c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:10349:x1868815139926400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241164.512035:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e438c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:10349:x1868815139926400:12345-0@lo:502:llog_process_th.0 Request processed in 378us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241164.512044:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1782241164.512216:0:10349:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10349:1868815139926400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782241164.512259:0:10349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241164.512270:0:10349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241164.512273:0:10349:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782241164.512280:0:10349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782241164.512336:0:10349:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a26a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10349:1868815139926528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241164.512385:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241164.512433:0:10349:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77983b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782241164.512494:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139926528 00000100:00100000:0.0:1782241164.512500:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139926528 00000100:00100000:0.0:1782241164.512569:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1782241164.512579:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e438c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:10349:x1868815139926528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241164.512694:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e438c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:10349:x1868815139926528:12345-0@lo:502:llog_process_th.0 Request processed in 117us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241164.512701:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1782241164.513014:0:10349:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a26a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10349:1868815139926528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782241164.513033:0:10349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241164.513037:0:10349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241164.513039:0:10349:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782241164.513063:0:10349:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1782241164.513328:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1782241164.513358:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1782241164.513371:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19741 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.513384:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19741 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241164.513395:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782241164.513399:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e48138000 from 48 10000000:01000000:3.0:1782241164.513402:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782241164.513436:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.513444:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.513454:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241164.513472:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139926656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782241164.513519:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241164.513563:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1782241164.513738:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139926656 00000100:00100000:2.0:1782241164.513744:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139926656 00000100:00100000:2.0:1782241164.513903:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1782241164.513913:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139926656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241164.513926:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241164.513941:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b860600/0xc9959f2fb1e1974f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19748 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.513967:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b860600/0xc9959f2fb1e1974f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19748 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.513978:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b860600/0xc9959f2fb1e1974f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19748 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.513988:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860600, rc 0) 00000100:00100000:2.0:1782241164.514118:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139926656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.514125:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1782241164.514359:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139926656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241164.514376:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1974f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241164.514384:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1974f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241164.514453:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139926784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241164.514485:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241164.514569:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8000 going to sleep for 11 seconds 00000100:00100000:3.0:1782241164.514601:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139926784 00000100:00100000:3.0:1782241164.514622:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139926784 00000100:00100000:3.0:1782241164.514687:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1782241164.514695:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139926784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241164.514877:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139926784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241164.514885:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1782241164.514956:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139926784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241164.514989:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139926912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241164.515031:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241164.515652:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139926912 00000100:00100000:2.0:1782241164.515659:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139926912 00000100:00100000:2.0:1782241164.515688:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1782241164.515696:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139926912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241164.515908:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8000 going to sleep for 11 seconds 00000100:00100000:2.0:1782241164.516034:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139926912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 338us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.516042:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1782241164.516132:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139926912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782241164.517170:0:10350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10350:1868815139927040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241164.517242:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241164.517323:0:10350:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503a93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241164.517359:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139927040 00000100:00100000:2.0:1782241164.517366:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139927040 00000100:00100000:2.0:1782241164.517449:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1782241164.517460:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+22:10350:x1868815139927040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241164.517649:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+22:10350:x1868815139927040:12345-0@lo:502:llog_process_th.0 Request processed in 190us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.517657:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1782241164.518279:0:10350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10350:1868815139927040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241164.518382:0:10350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10350:1868815139927168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241164.518435:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241164.518938:0:10350:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503a93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241164.519086:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139927168 00000100:00100000:2.0:1782241164.519094:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139927168 00000100:00100000:2.0:1782241164.519241:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1782241164.519250:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+22:10350:x1868815139927168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241164.519399:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+22:10350:x1868815139927168:12345-0@lo:502:llog_process_th.0 Request processed in 150us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.519407:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1782241164.519498:0:10350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10350:1868815139927168:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782241164.519523:0:10350:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1782241164.519699:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1782241164.519731:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782241164.519745:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1974f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.519918:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1974f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241164.519931:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782241164.519934:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1782241164.519937:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782241164.519971:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.519980:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.519991:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241164.520007:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139927296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782241164.520044:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241164.520071:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa600 going to sleep for 11 seconds 00000100:00100000:1.0:1782241164.520176:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139927296 00000100:00100000:1.0:1782241164.520181:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139927296 00000100:00100000:1.0:1782241164.520204:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1782241164.520210:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139927296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241164.520221:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241164.520236:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e82057c00/0xc9959f2fb1e1975d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19756 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241164.520259:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e82057c00/0xc9959f2fb1e1975d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19756 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241164.520270:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e82057c00/0xc9959f2fb1e1975d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19756 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241164.520280:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e82057c00, rc 0) 00000100:00100000:1.0:1782241164.520328:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139927296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241164.520334:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1782241164.520402:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139927296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241164.520415:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1975d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.520424:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1975d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241164.520480:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139927424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241164.520501:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241164.520527:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa600 going to sleep for 11 seconds 00000100:00100000:1.0:1782241164.520565:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139927424 00000100:00100000:1.0:1782241164.520569:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139927424 00000100:00100000:1.0:1782241164.520584:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1782241164.520588:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139927424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241164.520701:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139927424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241164.520708:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1782241164.520945:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139927424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241164.520972:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139927552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241164.521007:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241164.521057:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa600 going to sleep for 11 seconds 00000100:00100000:2.0:1782241164.521134:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139927552 00000100:00100000:2.0:1782241164.521138:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139927552 00000100:00100000:2.0:1782241164.521158:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1782241164.521165:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139927552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241164.521250:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139927552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.521257:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1782241164.521383:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139927552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241164.521832:0:10351:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10351:1868815139927680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241164.521871:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241164.521889:0:10351:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241164.522050:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139927680 00000100:00100000:2.0:1782241164.522056:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139927680 00000100:00100000:2.0:1782241164.522089:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1782241164.522154:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:10351:x1868815139927680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241164.522254:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:10351:x1868815139927680:12345-0@lo:502:llog_process_th.0 Request processed in 159us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.522262:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1782241164.522395:0:10351:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10351:1868815139927680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782241164.522424:0:10351:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241164.522436:0:10351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241164.522440:0:10351:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782241164.522446:0:10351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782241164.522468:0:10351:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10351:1868815139927808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241164.522505:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241164.522541:0:10351:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241164.522585:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139927808 00000100:00100000:2.0:1782241164.522590:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139927808 00000100:00100000:2.0:1782241164.522619:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1782241164.522625:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:10351:x1868815139927808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241164.522697:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:10351:x1868815139927808:12345-0@lo:502:llog_process_th.0 Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.522704:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1782241164.524015:0:10351:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10351:1868815139927808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782241164.524058:0:10351:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241164.524069:0:10351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241164.524072:0:10351:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782241164.524076:0:10351:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1782241164.524448:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1782241164.524477:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782241164.524501:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1975d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241164.524513:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1975d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241164.524525:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782241164.524529:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff890e43633380 from 1 10000000:01000000:0.0:1782241164.524532:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782241164.524572:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c2000/0xc9959f2fb1e19764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241164.524581:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e821c2000/0xc9959f2fb1e19764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241164.524592:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e821c2000/0xc9959f2fb1e19764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241164.524612:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139927936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782241164.524670:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241164.524931:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241164.525004:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139927936 00000100:00100000:2.0:1782241164.525012:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139927936 00000100:00100000:2.0:1782241164.525056:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1782241164.525064:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139927936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241164.525083:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241164.525199:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1976b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19764 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.525229:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1976b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19764 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.525241:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1976b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19764 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.525253:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861600, rc 0) 00000100:00100000:2.0:1782241164.525316:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139927936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 251us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.525332:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1782241164.525406:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139927936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241164.525421:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e821c2000/0xc9959f2fb1e19764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1976b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241164.525432:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e821c2000/0xc9959f2fb1e19764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1976b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241164.525493:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139928064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241164.525527:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241164.525583:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241164.525638:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139928064 00000100:00100000:2.0:1782241164.525643:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139928064 00000100:00100000:2.0:1782241164.525699:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1782241164.525706:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139928064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241164.525835:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139928064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (306us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782241164.525842:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1782241164.526015:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139928064:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1782241164.526044:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782241164.526051:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c2000/0xc9959f2fb1e19764 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1976b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241164.526060:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e821c2000/0xc9959f2fb1e19764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1976b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.933990:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241164.954722:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241164.955046:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119947392 00000100:00100000:2.0:1782241164.955059:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119947392 00000100:00100000:2.0:1782241164.955138:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 243 00000100:00100000:2.0:1782241164.955151:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+8:6169:x1868815119947392:12345-192.168.204.58@tcp:101: 00010000:00010000:2.0:1782241164.955176:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241164.955209:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b860a00/0xc9959f2fb1e19772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d33350501c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.955252:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b860a00/0xc9959f2fb1e19772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350501c expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.955267:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b860a00/0xc9959f2fb1e19772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350501c expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241164.955277:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860a00, rc 0) 00000100:00100000:2.0:1782241164.955367:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:6169:x1868815119947392:12345-192.168.204.58@tcp:101: Request processed in 219us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.955375:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 243 00000100:00100000:0.0:1782241164.959101:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241164.959320:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119947520 00000100:00100000:2.0:1782241164.959333:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119947520 00000100:00100000:2.0:1782241164.959398:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 244 00000100:00100000:2.0:1782241164.959408:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:6169:x1868815119947520:12345-192.168.204.58@tcp:501: 00000100:00100000:2.0:1782241164.959666:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:6169:x1868815119947520:12345-192.168.204.58@tcp:501: Request processed in 258us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.959675:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 244 00000100:00100000:0.0:1782241164.969752:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241164.970172:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119947648 00000100:00100000:1.0:1782241164.970187:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119947648 00000100:00100000:1.0:1782241164.970274:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 245 00000100:00100000:1.0:1782241164.970298:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:6169:x1868815119947648:12345-192.168.204.58@tcp:503: 00000100:00100000:1.0:1782241164.970505:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:6169:x1868815119947648:12345-192.168.204.58@tcp:503: Request processed in 210us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241164.970515:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 245 00000100:00100000:1.0:1782241164.974301:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241164.976612:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119947776 00000100:00100000:0.0:1782241164.976645:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119947776 00000100:00100000:0.0:1782241164.976933:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 246 00000100:00100000:0.0:1782241164.976945:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:6651:x1868815119947776:12345-192.168.204.58@tcp:502: 00000100:00100000:0.0:1782241164.977247:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:6651:x1868815119947776:12345-192.168.204.58@tcp:502: Request processed in 303us (2967us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241164.977256:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 246 00000100:00100000:0.0:1782241164.984448:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241164.984656:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119947904 00000100:00100000:2.0:1782241164.984671:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119947904 00000100:00100000:2.0:1782241164.984851:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 247 00000100:00100000:2.0:1782241164.984865:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:6651:x1868815119947904:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782241164.985671:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:6651:x1868815119947904:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 802us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241164.985684:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 247 00000100:00100000:2.0:1782241165.006993:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241165.007622:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119948032 00000100:00100000:1.0:1782241165.007636:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119948032 00000100:00100000:1.0:1782241165.007840:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 248 00000100:00100000:1.0:1782241165.007854:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:6169:x1868815119948032:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241165.007879:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241165.007904:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e82056400/0xc9959f2fb1e19779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d333505023 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241165.007967:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e82056400/0xc9959f2fb1e19779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505023 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241165.007981:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e82056400/0xc9959f2fb1e19779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505023 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241165.007992:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e82056400, rc 0) 00000100:00100000:1.0:1782241165.008081:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6169:x1868815119948032:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 Request processed in 230us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241165.008090:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 248 00000100:00100000:3.0:1782241165.016172:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241165.016933:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119948160 00000100:00100000:2.0:1782241165.016948:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119948160 00000100:00100000:2.0:1782241165.017035:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 249 00000100:00100000:2.0:1782241165.017048:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6169:x1868815119948160:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241165.017224:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6169:x1868815119948160:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 Request processed in 177us (1070us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782241165.017234:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 249 00000100:00100000:3.0:1782241165.574856:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241165.574887:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139928192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241165.574983:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241165.575159:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782241165.575171:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139928320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241165.575920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241165.576125:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139928192 00000100:00100000:1.0:1782241165.576135:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139928192 00000100:00100000:1.0:1782241165.576199:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139928320 00000100:00100000:1.0:1782241165.576203:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139928320 00000100:00100000:1.0:1782241165.576224:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782241165.576234:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139928192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782241165.576285:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241165.576368:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139928192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241165.576377:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782241165.576398:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782241165.576406:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139928320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782241165.576416:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241165.576443:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139928320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241165.576449:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1782241165.576502:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4789f480 x1868815139928192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1782241165.576517:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793ce00 x1868815139928320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241165.576544:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139928320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241165.576546:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139928192:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782241165.576741:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782241165.958504:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782241166.010700:0:10388:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd31193e0 20000000:00000080:0.0:1782241166.010718:0:10388:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff890d475ab400 uarg=0000000000000000 20000000:01000000:0.0:1782241166.010909:0:10388:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782241166.010915:0:10388:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782241166.010920:0:10388:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1782241166.011440:0:10389:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1782241166.011595:0:10388:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1782241166.015978:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1782241166.016017:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1782241166.016033:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1782241166.016065:0:10388:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782241166.016086:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e778f1600/0xc9959f2fb1e19780 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.016104:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1941c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19415 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.016112:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164dc00/0xc9959f2fb1e1942a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19423 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.016119:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e47180600/0xc9959f2fb1e1947e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19477 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.016125:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4b861e00/0xc9959f2fb1e195a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1959d expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.016135:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e196bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fe4 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.016143:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e778f1600/0xc9959f2fb1e19780 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.016301:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e196bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fe4 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.016317:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e196bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fe4 expref: 9 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241166.016332:0:10388:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1868815139928448:192.168.204.58@tcp:104: 00010000:00010000:0.0:1782241166.016435:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4b861e00/0xc9959f2fb1e195a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1959d expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.016937:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e4b861e00/0xc9959f2fb1e195a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1959d expref: 23 pid: 6504 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241166.016948:0:10388:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1868815139928576:0@lo:104: 00000100:00100000:0.0:1782241166.016989:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782241166.017080:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e47180600/0xc9959f2fb1e1947e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19477 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.017099:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e47180600/0xc9959f2fb1e1947e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19477 expref: 23 pid: 6503 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241166.017108:0:10388:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1868815139928704:0@lo:104: 00000100:00100000:0.0:1782241166.017133:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782241166.019324:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164dc00/0xc9959f2fb1e1942a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19423 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.019341:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e8164dc00/0xc9959f2fb1e1942a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19423 expref: 23 pid: 6503 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241166.019355:0:10388:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1868815139928832:0@lo:104: 00010000:00010000:0.0:1782241166.019399:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1941c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19415 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.019407:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1941c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19415 expref: 23 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241166.019417:0:10388:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1868815139928960:0@lo:104: 00000100:00100000:0.0:1782241166.019433:0:10388:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8840 going to sleep for 11 seconds 00000100:00100000:1.0:1782241166.019545:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782241166.019568:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241166.019585:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241166.019596:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139928576 00000100:00100000:1.0:1782241166.019602:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139928576 00000100:00100000:1.0:1782241166.019642:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139928704 00000100:00100000:1.0:1782241166.019645:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139928704 00000100:00100000:1.0:1782241166.019656:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139928832 00000100:00100000:1.0:1782241166.019658:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139928832 00000100:00100000:1.0:1782241166.019668:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139928960 00000100:00100000:1.0:1782241166.019669:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139928960 00000100:00100000:1.0:1782241166.019681:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782241166.019689:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+6:10388:x1868815139928576:12345-0@lo:104: 00010000:00010000:1.0:1782241166.019701:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e1959d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e195a4 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241166.019854:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782241166.019861:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+6:10388:x1868815139928576:12345-0@lo:104: Request processed in 172us (2872us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241166.019869:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782241166.019888:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782241166.019893:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d76e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+5:10388:x1868815139928704:12345-0@lo:104: 00010000:00010000:1.0:1782241166.019901:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e19477 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1947e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241166.019936:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782241166.019947:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d76e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+5:10388:x1868815139928704:12345-0@lo:104: Request processed in 54us (2814us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241166.019954:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782241166.019985:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782241166.019991:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:10388:x1868815139928832:12345-0@lo:104: 00010000:00010000:1.0:1782241166.019999:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e19423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1942a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241166.020034:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782241166.020039:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:10388:x1868815139928832:12345-0@lo:104: Request processed in 50us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241166.020045:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782241166.020057:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782241166.020064:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:10388:x1868815139928960:12345-0@lo:104: 00010000:00010000:1.0:1782241166.020070:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164ca00/0xc9959f2fb1e19415 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1941c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241166.020099:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1782241166.020104:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:10388:x1868815139928960:12345-0@lo:104: Request processed in 41us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241166.020109:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1782241166.020127:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1782241166.020133:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e1959d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e195a4 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241166.020141:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40031600 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241166.020145:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e1959d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e195a4 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020253:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782241166.020259:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e19477 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1947e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020276:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d800 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241166.020279:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e19477 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1947e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020288:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e19477 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1947e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241166.020301:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e19477 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1947e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241166.020307:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782241166.020336:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e19477 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1947e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020342:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241166.020360:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e19477 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1947e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020367:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164d800/0xc9959f2fb1e19477 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1947e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020379:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241166.020382:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e19423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1942a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020388:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e47181a00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241166.020391:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e19423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1942a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020397:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e19423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1942a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241166.020403:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e19423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1942a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241166.020408:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782241166.020426:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e19423 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1942a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020432:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241166.020458:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e19423 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1942a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020466:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e19423 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1942a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020474:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241166.020476:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164ca00/0xc9959f2fb1e19415 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1941c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020482:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164ca00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241166.020485:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164ca00/0xc9959f2fb1e19415 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1941c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020491:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164ca00/0xc9959f2fb1e19415 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1941c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241166.020497:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164ca00/0xc9959f2fb1e19415 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1941c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241166.020502:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782241166.020512:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164ca00/0xc9959f2fb1e19415 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1941c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020517:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241166.020523:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164ca00/0xc9959f2fb1e19415 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1941c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020539:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164ca00/0xc9959f2fb1e19415 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1941c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020548:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241166.020550:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241166.020552:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241166.020558:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241166.020570:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139929088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241166.020603:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241166.020648:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139929216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241166.020668:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241166.020687:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241166.020693:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139929344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241166.020711:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241166.020737:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139929088 00000100:00100000:3.0:1782241166.020742:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139929088 00010000:00010000:3.0:1782241166.020776:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e47180600/0xc9959f2fb1e1947e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19477 expref: 24 pid: 6503 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241166.020800:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139929216 00000100:00100000:3.0:1782241166.020802:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139929216 00010000:00010000:3.0:1782241166.020813:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164dc00/0xc9959f2fb1e1942a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19423 expref: 25 pid: 6503 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241166.020825:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139929344 00000100:00100000:3.0:1782241166.020828:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139929344 00010000:00010000:3.0:1782241166.020836:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1941c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19415 expref: 26 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241166.020859:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782241166.020864:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+26:3640:x1868815139929088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782241166.020874:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241166.020879:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e47180600/0xc9959f2fb1e1947e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19477 expref: 26 pid: 6503 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020888:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e47180600/0xc9959f2fb1e1947e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19477 expref: 26 pid: 6503 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020903:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241166.020928:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+26:3640:x1868815139929088:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241166.020934:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782241166.020946:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782241166.020952:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+25:3637:x1868815139929216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782241166.020958:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241166.020962:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164dc00/0xc9959f2fb1e1942a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19423 expref: 25 pid: 6503 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020969:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164dc00/0xc9959f2fb1e1942a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19423 expref: 25 pid: 6503 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.020977:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241166.020997:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+25:3637:x1868815139929216:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241166.021003:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782241166.021013:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782241166.021025:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815139929344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782241166.021033:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241166.021037:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1941c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19415 expref: 24 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.021044:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1941c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19415 expref: 24 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241166.021053:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241166.021072:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815139929344:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241166.021077:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782241166.021116:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139929088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241166.021135:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139929344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241166.021141:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139929216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241166.021366:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e1959d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e195a4 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241166.021374:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e1959d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e195a4 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241166.021379:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782241166.021396:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e1959d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e195a4 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241166.021403:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241166.021423:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e1959d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e195a4 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241166.021431:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e40031600/0xc9959f2fb1e1959d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e195a4 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241166.021496:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241166.021498:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241166.021500:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241166.021506:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241166.021577:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139929472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241166.021609:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241166.021669:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139929472 00000100:00100000:1.0:1782241166.021674:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139929472 00010000:00010000:1.0:1782241166.021689:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4b861e00/0xc9959f2fb1e195a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1959d expref: 24 pid: 6504 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241166.021712:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782241166.021717:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e477c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139929472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241166.021724:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241166.021734:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4b861e00/0xc9959f2fb1e195a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1959d expref: 24 pid: 6504 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241166.021742:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4b861e00/0xc9959f2fb1e195a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1959d expref: 24 pid: 6504 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241166.021752:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241166.021797:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e477c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139929472:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241166.021804:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782241166.021890:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139929472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241166.021953:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:0.0:1782241166.022226:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b861e00/0xc9959f2fb1e195a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1959d expref: 23 pid: 6504 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241166.022237:0:10388:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1868815139928576:0@lo:104: 00010000:00010000:0.0:1782241166.022307:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e47180600/0xc9959f2fb1e1947e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19477 expref: 22 pid: 6503 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241166.022316:0:10388:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1868815139928704:0@lo:104: 00010000:00010000:0.0:1782241166.022324:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164dc00/0xc9959f2fb1e1942a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19423 expref: 21 pid: 6503 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241166.022331:0:10388:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1868815139928832:0@lo:104: 00010000:00010000:0.0:1782241166.022340:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164c600/0xc9959f2fb1e1941c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19415 expref: 20 pid: 6505 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241166.022348:0:10388:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1868815139928960:0@lo:104: 00000100:00100000:0.0:1782241166.024873:0:10388:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1868815139928448:192.168.204.58@tcp:104: 00010000:00010000:0.0:1782241166.024912:0:10388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e778f1600/0xc9959f2fb1e19780 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241166.035288:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241166.035375:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119948288 00000100:00100000:0.0:1782241166.035390:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119948288 00010000:00010000:0.0:1782241166.035441:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e196bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fe4 expref: 10 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241166.035484:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 39 00000100:00100000:0.0:1782241166.035493:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2399:x1868815119948288:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241166.035509:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241166.035530:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e196bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fe4 expref: 10 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.035543:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e196bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fe4 expref: 10 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.035560:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b860400/0xc9959f2fb1e196bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fe4 expref: 10 pid: 6505 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.035577:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e778f1600/0xc9959f2fb1e19780 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.035586:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e778f1600/0xc9959f2fb1e19780 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.035603:0:10330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e778f1600/0xc9959f2fb1e19780 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.035609:0:10330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e778f1600/0xc9959f2fb1e19780 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.035616:0:10330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e778f1600/0xc9959f2fb1e19780 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.035622:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e778f1600/0xc9959f2fb1e19780 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.035628:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241166.035632:0:10330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e778f1600/0xc9959f2fb1e19780 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.035640:0:10330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e778f1600/0xc9959f2fb1e19780 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.035673:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e778f1600/0xc9959f2fb1e19780 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.035686:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241166.035801:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:2399:x1868815119948288:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 308us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241166.035809:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 39 00010000:00010000:2.0:1782241166.036095:0:10388:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e778f1600/0xc9959f2fb1e19780 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241166.036115:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e778f1600/0xc9959f2fb1e19780 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241166.036121:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e778f1600/0xc9959f2fb1e19780 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241166.746706:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241166.746810:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119948416 00000100:00100000:0.0:1782241166.746820:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119948416 00000100:00100000:0.0:1782241166.746872:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 250 00000100:00100000:0.0:1782241166.746883:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:6169:x1868815119948416:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241166.746900:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241166.746918:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e778f1200/0xc9959f2fb1e19787 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d33350502a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.746943:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e778f1200/0xc9959f2fb1e19787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350502a expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.746954:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e778f1200/0xc9959f2fb1e19787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350502a expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241166.746963:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1200, rc 0) 00000100:00100000:0.0:1782241166.747024:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6169:x1868815119948416:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 Request processed in 144us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241166.747031:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 250 00000100:00100000:1.0:1782241166.772695:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241166.772864:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119948544 00000100:00100000:0.0:1782241166.772875:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119948544 00000100:00100000:0.0:1782241166.772938:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 251 00000100:00100000:0.0:1782241166.772947:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6169:x1868815119948544:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241166.773097:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6169:x1868815119948544:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 Request processed in 150us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241166.773106:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 251 00000100:00100000:3.0:1782241166.791148:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241166.797897:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119948672 00000100:00100000:1.0:1782241166.797914:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119948672 00000100:00100000:1.0:1782241166.797991:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 252 00000100:00100000:1.0:1782241166.798002:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6169:x1868815119948672:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782241166.799749:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6169:x1868815119948672:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 Request processed in 1738us (8599us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241166.799794:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 252 00000100:00100000:1.0:1782241166.810345:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241166.810443:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119948800 00000100:00100000:2.0:1782241166.810453:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119948800 00000100:00100000:2.0:1782241166.810513:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 253 00000100:00100000:2.0:1782241166.810524:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6708:x1868815119948800:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782241166.810702:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6708:x1868815119948800:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 175us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241166.810711:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 253 00000100:00100000:0.0:1782241166.821420:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241166.821547:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119948928 00000100:00100000:3.0:1782241166.821557:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119948928 00000100:00100000:3.0:1782241166.821815:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 254 00000100:00100000:3.0:1782241166.821827:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6708:x1868815119948928:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782241166.821987:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:6708:x1868815119948928:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 161us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241166.831143:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 254 00010000:00010000:0.0:1782241166.987536:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782241167.495051:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782241167.495060:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e77a72800 from 4 10000000:01000000:1.0:1782241167.495065:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782241167.495110:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40031200/0xc9959f2fb1e1978e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241167.495123:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e40031200/0xc9959f2fb1e1978e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241167.495134:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e40031200/0xc9959f2fb1e1978e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241167.495168:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139929600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782241167.495240:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241167.495287:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782241167.495345:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139929600 00000100:00100000:0.0:1782241167.495352:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139929600 00000100:00100000:0.0:1782241167.495406:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1782241167.495524:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139929600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241167.495538:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241167.495552:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e19795 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1978e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241167.495576:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e19795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1978e expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241167.495586:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e19795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1978e expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241167.495596:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1e00, rc 0) 00000100:00100000:0.0:1782241167.495731:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139929600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241167.495739:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1782241167.495851:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139929600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241167.495867:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e40031200/0xc9959f2fb1e1978e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241167.495876:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e40031200/0xc9959f2fb1e1978e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241167.495938:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139929728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241167.495962:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241167.495991:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782241167.496622:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139929728 00000100:00100000:0.0:1782241167.496630:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139929728 00000100:00100000:0.0:1782241167.496991:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1782241167.497007:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b8a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139929728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241167.497137:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b8a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139929728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241167.497144:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1782241167.497890:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139929728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241167.497936:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139929856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241167.497985:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241167.498057:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8000 going to sleep for 11 seconds 00000100:00100000:3.0:1782241167.501627:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139929856 00000100:00100000:3.0:1782241167.501640:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139929856 00000100:00100000:3.0:1782241167.502994:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1782241167.503007:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b8a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139929856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241167.503718:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b8a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139929856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 712us (5730us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241167.503727:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1782241167.503944:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139929856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241167.504162:0:10450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10450:1868815139929984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241167.504212:0:10450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241167.504255:0:10450:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f72b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782241167.507547:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139929984 00000100:00100000:0.0:1782241167.507561:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139929984 00000100:00100000:0.0:1782241167.507615:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1782241167.507627:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b8a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:10450:x1868815139929984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241167.508042:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b8a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:10450:x1868815139929984:12345-0@lo:502:llog_process_th.0 Request processed in 416us (3827us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241167.508051:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1782241167.508695:0:10450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10450:1868815139929984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782241167.508735:0:10450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241167.508744:0:10450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241167.508747:0:10450:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782241167.508752:0:10450:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890e77a72800 00000020:00000080:3.0:1782241167.508777:0:10450:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782241167.508859:0:10450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10450:1868815139930112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241167.508912:0:10450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241167.508943:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139930112 00000100:00100000:3.0:1782241167.508948:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139930112 00000100:00100000:3.0:1782241167.508985:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1782241167.509001:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:10450:x1868815139930112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241167.509084:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:10450:x1868815139930112:12345-0@lo:502:llog_process_th.0 Request processed in 85us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241167.509091:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1782241167.509140:0:10450:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f72b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241167.509156:0:10450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10450:1868815139930112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782241167.509174:0:10450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241167.509178:0:10450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241167.509180:0:10450:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782241167.509184:0:10450:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782241167.509260:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782241167.509280:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782241167.509365:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40031200/0xc9959f2fb1e1978e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241167.509376:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e40031200/0xc9959f2fb1e1978e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241167.509388:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782241167.509390:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e7d6df800 from 4 10000000:01000000:3.0:1782241167.509393:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782241167.509420:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47181600/0xc9959f2fb1e1979c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241167.509429:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e47181600/0xc9959f2fb1e1979c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241167.509438:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e47181600/0xc9959f2fb1e1979c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241167.509463:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139930240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782241167.509492:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241167.509507:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f72b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782241167.515330:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139930240 00000100:00100000:0.0:1782241167.515345:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139930240 00000100:00100000:0.0:1782241167.515400:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1782241167.515410:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139930240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241167.515785:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241167.515803:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e778f0600/0xc9959f2fb1e197a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1979c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241167.515832:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e778f0600/0xc9959f2fb1e197a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1979c expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241167.515854:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e778f0600/0xc9959f2fb1e197a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1979c expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241167.515863:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0600, rc 0) 00000100:00100000:0.0:1782241167.515949:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139930240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 540us (6456us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241167.515957:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1782241167.516158:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139930240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241167.516176:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e47181600/0xc9959f2fb1e1979c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e197a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241167.516185:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e47181600/0xc9959f2fb1e1979c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e197a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241167.516268:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139930368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241167.516304:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241167.516336:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1782241167.516348:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139930368 00000100:00100000:0.0:1782241167.516352:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139930368 00000100:00100000:0.0:1782241167.516373:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1782241167.516379:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139930368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241167.518502:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139930368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1268us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241167.518518:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1782241167.518842:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139930368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241167.518902:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139930496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241167.518953:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241167.518989:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e437483c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241167.519003:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139930496 00000100:00100000:0.0:1782241167.519008:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139930496 00000100:00100000:0.0:1782241167.519038:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1782241167.519046:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139930496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241167.519139:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139930496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241167.519146:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1782241167.519186:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139930496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241167.521948:0:10453:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10453:1868815139930624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241167.522028:0:10453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241167.522076:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139930624 00000100:00100000:0.0:1782241167.522083:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139930624 00000100:00100000:0.0:1782241167.522123:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1782241167.522135:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+22:10453:x1868815139930624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241167.522258:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+22:10453:x1868815139930624:12345-0@lo:502:llog_process_th.0 Request processed in 125us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241167.522266:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1782241167.522317:0:10453:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782241167.522337:0:10453:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10453:1868815139930624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782241167.522363:0:10453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782241167.522372:0:10453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241167.522380:0:10453:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782241167.522387:0:10453:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890e7d6df800 00000020:00000080:0.0:1782241167.522390:0:10453:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782241167.524088:0:10453:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10453:1868815139930752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241167.524146:0:10453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241167.524181:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139930752 00000100:00100000:0.0:1782241167.524186:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139930752 00000100:00100000:0.0:1782241167.524219:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1782241167.524227:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+22:10453:x1868815139930752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241167.524334:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+22:10453:x1868815139930752:12345-0@lo:502:llog_process_th.0 Request processed in 106us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241167.524342:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1782241167.524383:0:10453:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782241167.524398:0:10453:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10453:1868815139930752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782241167.525514:0:10453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241167.525523:0:10453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241167.525526:0:10453:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1782241167.525530:0:10453:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1782241167.525603:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1782241167.525622:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782241167.525632:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47181600/0xc9959f2fb1e1979c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e197a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241167.525643:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e47181600/0xc9959f2fb1e1979c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e197a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241167.525652:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782241167.525667:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e43609000 from 4 10000000:01000000:0.0:1782241167.525671:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782241167.525804:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1c00/0xc9959f2fb1e197aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241167.525813:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e778f1c00/0xc9959f2fb1e197aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241167.525824:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e778f1c00/0xc9959f2fb1e197aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241167.525844:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139930880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782241167.525893:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241167.525930:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782241167.525950:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139930880 00000100:00100000:0.0:1782241167.525955:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139930880 00000100:00100000:0.0:1782241167.525993:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1782241167.525999:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139930880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241167.526010:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241167.526023:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e778f1a00/0xc9959f2fb1e197b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e197aa expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241167.526043:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e778f1a00/0xc9959f2fb1e197b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e197aa expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241167.526054:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e778f1a00/0xc9959f2fb1e197b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e197aa expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241167.526062:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1a00, rc 0) 00000100:00100000:0.0:1782241167.526094:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139930880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241167.526100:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1782241167.526147:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139930880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241167.526161:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e778f1c00/0xc9959f2fb1e197aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e197b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241167.526170:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e778f1c00/0xc9959f2fb1e197aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e197b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241167.526216:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139931008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241167.526252:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241167.526266:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782241167.526278:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139931008 00000100:00100000:0.0:1782241167.526281:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139931008 00000100:00100000:0.0:1782241167.526301:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1782241167.526306:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139931008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241167.527540:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139931008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1228us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241167.527551:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1782241167.527604:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139931008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241167.527644:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139931136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241167.527857:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241167.527900:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77963180 going to sleep for 11 seconds 00000100:00100000:0.0:1782241167.527918:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139931136 00000100:00100000:0.0:1782241167.527923:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139931136 00000100:00100000:0.0:1782241167.527962:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1782241167.527971:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139931136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241167.528073:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139931136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241167.528085:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1782241167.528134:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139931136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241167.528342:0:10455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10455:1868815139931264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241167.528393:0:10455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241167.528416:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139931264 00000100:00100000:3.0:1782241167.528420:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139931264 00000100:00100000:3.0:1782241167.528445:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1782241167.528452:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:10455:x1868815139931264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241167.528520:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:10455:x1868815139931264:12345-0@lo:502:llog_process_th.0 Request processed in 69us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241167.528527:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1782241167.528572:0:10455:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f72f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241167.528586:0:10455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10455:1868815139931264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782241167.528610:0:10455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241167.528620:0:10455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241167.528623:0:10455:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782241167.528631:0:10455:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890e43609000 00000020:00000080:3.0:1782241167.528634:0:10455:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782241167.529118:0:10455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10455:1868815139931392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241167.529153:0:10455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241167.529175:0:10455:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f72f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782241167.534376:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139931392 00000100:00100000:0.0:1782241167.534388:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139931392 00000100:00100000:0.0:1782241167.534445:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1782241167.534455:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:10455:x1868815139931392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241167.534618:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:10455:x1868815139931392:12345-0@lo:502:llog_process_th.0 Request processed in 164us (5464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241167.534626:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1782241167.535899:0:10455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10455:1868815139931392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782241167.535936:0:10455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241167.535944:0:10455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241167.535946:0:10455:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1782241167.535950:0:10455:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782241167.539842:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782241167.539879:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782241167.539891:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1c00/0xc9959f2fb1e197aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e197b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241167.539909:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e778f1c00/0xc9959f2fb1e197aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e197b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241167.539921:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782241167.539924:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e48138000 from 4 10000000:01000000:3.0:1782241167.539926:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782241167.539964:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e197b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241167.539972:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e197b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241167.539984:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e197b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241167.540009:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139931520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782241167.540077:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241167.540116:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f72b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241167.540546:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139931520 00000100:00100000:3.0:1782241167.540554:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139931520 00000100:00100000:3.0:1782241167.540600:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1782241167.540608:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139931520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241167.540621:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241167.540632:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e47180200/0xc9959f2fb1e197bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e197b8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241167.541174:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e47180200/0xc9959f2fb1e197bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e197b8 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241167.541204:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e47180200/0xc9959f2fb1e197bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e197b8 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241167.541214:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e47180200, rc 0) 00000100:00100000:3.0:1782241167.541323:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139931520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 714us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241167.541330:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1782241167.542462:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139931520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241167.542494:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e197b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e197bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241167.542506:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e197b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e197bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241167.542624:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139931648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241167.542668:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241167.542717:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e779639c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241167.544169:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139931648 00000100:00100000:3.0:1782241167.544179:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139931648 00000100:00100000:3.0:1782241167.544227:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1782241167.544248:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139931648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241167.544389:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139931648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241167.544397:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1782241167.544440:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139931648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241167.544477:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139931776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241167.544522:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241167.544547:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f72f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241167.544560:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139931776 00000100:00100000:3.0:1782241167.544563:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139931776 00000100:00100000:3.0:1782241167.544584:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1782241167.544590:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139931776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241167.544674:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139931776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241167.544684:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1782241167.544730:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139931776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241167.544953:0:10457:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10457:1868815139931904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241167.544986:0:10457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241167.545005:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139931904 00000100:00100000:3.0:1782241167.545009:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139931904 00000100:00100000:3.0:1782241167.545036:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1782241167.545042:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:10457:x1868815139931904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241167.545108:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:10457:x1868815139931904:12345-0@lo:502:llog_process_th.0 Request processed in 65us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241167.545115:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1782241167.545154:0:10457:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f72e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241167.545169:0:10457:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10457:1868815139931904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782241167.545193:0:10457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241167.545203:0:10457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241167.545205:0:10457:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782241167.545218:0:10457:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890e48138000 00000020:00000080:3.0:1782241167.545220:0:10457:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782241167.545551:0:10457:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10457:1868815139932032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241167.545587:0:10457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241167.545606:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139932032 00000100:00100000:3.0:1782241167.545609:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139932032 00000100:00100000:3.0:1782241167.545626:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1782241167.545632:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:10457:x1868815139932032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241167.545693:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:10457:x1868815139932032:12345-0@lo:502:llog_process_th.0 Request processed in 60us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241167.545700:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1782241167.545736:0:10457:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f72e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241167.545749:0:10457:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:10457:1868815139932032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782241167.545785:0:10457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241167.545789:0:10457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241167.545791:0:10457:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782241167.545796:0:10457:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782241167.545844:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782241167.545861:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782241167.545871:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e197b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e197bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241167.545883:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e197b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e197bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241167.622519:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241167.622543:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139932160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241167.622610:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241167.623322:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139932160 00000100:00100000:3.0:1782241167.623331:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139932160 00000100:00100000:3.0:1782241167.623389:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782241167.623400:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139932160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782241167.623439:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782241167.623507:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139932160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241167.623515:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782241167.623556:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139932160:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782241168.005952:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241168.645741:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815139932672:0@lo:400:kworker.0 00000100:00100000:2.0:1782241168.645829:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241168.645893:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139933184:0@lo:400:kworker.0 00000100:00100000:2.0:1782241168.645920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241168.645945:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139933696:0@lo:400:kworker.0 00000100:00100000:2.0:1782241168.645968:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241168.645998:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1782241168.646004:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139932544:0@lo:400:kworker.0 00000100:00100000:2.0:1782241168.646028:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241168.646048:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815139933056:0@lo:400:kworker.0 00000100:00100000:2.0:1782241168.646066:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241168.646085:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815139933568:0@lo:400:kworker.0 00000100:00100000:2.0:1782241168.646123:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241168.646155:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139932672 00000100:00100000:2.0:1782241168.646163:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139932672 00000100:00100000:2.0:1782241168.646207:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139933056 00000100:00100000:2.0:1782241168.646223:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139933056 00000100:00100000:2.0:1782241168.646245:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139933568 00000100:00100000:2.0:1782241168.646248:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139933568 00000100:00100000:2.0:1782241168.646263:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782241168.646269:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815139932672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241168.646323:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815139932672:12345-0@lo:400:kworker.0 Request processed in 54us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241168.646331:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782241168.646348:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782241168.646354:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815139933056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241168.646381:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815139933056:12345-0@lo:400:kworker.0 Request processed in 27us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241168.646387:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782241168.646398:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782241168.646404:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815139933568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241168.646430:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815139933568:12345-0@lo:400:kworker.0 Request processed in 26us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241168.646435:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782241168.646453:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139933184 00000100:00100000:1.0:1782241168.646563:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139932416:0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.646594:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241168.646614:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139932928:0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.646635:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241168.646645:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139933440:0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.646668:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241168.646694:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1782241168.646701:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139932288:0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.646727:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241168.646745:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139932800:0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.646802:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241168.646818:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139933312:0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.646838:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241168.646856:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139933824:0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.646875:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241168.646904:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139932544 00000100:00100000:1.0:1782241168.646909:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139932544 00000100:00100000:1.0:1782241168.646936:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139932800 00000100:00100000:1.0:1782241168.646938:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139932800 00000100:00100000:1.0:1782241168.646953:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782241168.646960:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139932544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.646992:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139932544:12345-0@lo:400:kworker.0 Request processed in 33us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241168.646999:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782241168.647012:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782241168.647017:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139932800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.647045:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139932800:12345-0@lo:400:kworker.0 Request processed in 28us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241168.647051:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782241168.647067:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139933696 00000100:00100000:1.0:1782241168.647070:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139933696 00000100:00100000:1.0:1782241168.647094:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139933312 00000100:00100000:1.0:1782241168.647097:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139933312 00000100:00100000:1.0:1782241168.647118:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139933824 00000100:00100000:1.0:1782241168.647121:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139933824 00000100:00100000:1.0:1782241168.647134:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782241168.647140:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139933696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.647172:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139933696:12345-0@lo:400:kworker.0 Request processed in 32us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241168.647178:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782241168.647189:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782241168.647194:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139933312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.647230:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139933312:12345-0@lo:400:kworker.0 Request processed in 36us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241168.647236:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782241168.647247:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782241168.647252:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139933824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.647275:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139933824:12345-0@lo:400:kworker.0 Request processed in 23us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241168.647280:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782241168.647314:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139932416 00000100:00100000:1.0:1782241168.647318:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139932416 00000100:00100000:1.0:1782241168.647332:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139932928 00000100:00100000:1.0:1782241168.647335:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139932928 00000100:00100000:1.0:1782241168.647345:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139933440 00000100:00100000:1.0:1782241168.647348:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139933440 00000100:00100000:1.0:1782241168.647360:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782241168.647365:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139932416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.647392:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139932416:12345-0@lo:400:kworker.0 Request processed in 27us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241168.647398:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782241168.647418:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782241168.647423:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139932928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.647450:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139932928:12345-0@lo:400:kworker.0 Request processed in 27us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241168.647525:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782241168.647540:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782241168.647546:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139933440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.647576:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139933440:12345-0@lo:400:kworker.0 Request processed in 31us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241168.647582:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782241168.647618:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139932800:0@lo:400:kworker.0 00010000:00080000:1.0:1782241168.647631:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a27480 x1868815139933312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241168.647641:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139933312:0@lo:400:kworker.0 00010000:00080000:1.0:1782241168.647651:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a25c00 x1868815139933824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241168.647659:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139933824:0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.647667:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139932416:0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.647676:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139932928:0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.647684:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139933440:0@lo:400:kworker.0 00000100:00080000:1.0:1782241168.647778:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782241168.647783:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782241168.647786:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241168.647793:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782241168.647825:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139932544:0@lo:400:kworker.0 00010000:00080000:1.0:1782241168.647837:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a24380 x1868815139933056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241168.647846:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815139933056:0@lo:400:kworker.0 00010000:00080000:1.0:1782241168.647858:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a25f80 x1868815139933568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241168.647866:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815139933568:0@lo:400:kworker.0 00000100:00100000:1.0:1782241168.647876:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815139932672:0@lo:400:kworker.0 00010000:00080000:1.0:1782241168.647886:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a24a80 x1868815139933696/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241168.647894:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139933696:0@lo:400:kworker.0 00000100:00100000:0.0:1782241168.648043:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139933952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241168.648083:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241168.648129:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139933952 00000100:00100000:0.0:1782241168.648134:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139933952 00000100:00100000:0.0:1782241168.648162:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782241168.648169:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f60aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139933952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782241168.648191:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241168.648240:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f60aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139933952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241168.648245:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1782241168.648270:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f60b100 x1868815139933952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241184 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241168.648283:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139933952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241168.648354:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139933184 00000100:00100000:2.0:1782241168.648389:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782241168.648396:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139933184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241168.648438:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139933184:12345-0@lo:400:kworker.0 Request processed in 43us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241168.648450:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782241168.648562:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139932288 00000100:00100000:3.0:1782241168.648567:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139932288 00000100:00100000:3.0:1782241168.648595:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1782241168.648602:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815139932288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241168.648640:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815139932288:12345-0@lo:400:kworker.0 Request processed in 39us (1911us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241168.648654:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:3.0:1782241168.648697:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782241168.648721:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a24700 x1868815139933184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241168.648731:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139933184:0@lo:400:kworker.0 00000100:00100000:0.0:1782241168.649243:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139932288:0@lo:400:kworker.0 00010000:00010000:1.0:1782241169.028931:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241169.157968:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139934080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241169.158081:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241169.158246:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139934080 00000100:00100000:0.0:1782241169.158256:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139934080 00000100:00100000:0.0:1782241169.158319:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782241169.158329:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139934080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241169.158359:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241169.158441:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139934080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241169.158449:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1782241169.158499:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f60b100 x1868815139934080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241169.158522:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139934080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241169.159145:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47854700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139934208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241169.159190:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241169.159294:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139934208 00000100:00100000:2.0:1782241169.159299:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139934208 00000100:00100000:2.0:1782241169.159340:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782241169.159347:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139934208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782241169.159469:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782241169.159527:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139934208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 180us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241169.159534:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782241169.159598:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47854700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139934208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241169.308122:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241169.309987:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241169.310044:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241169.310068:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241169.310100:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241169.310341:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119949312 00000100:00100000:2.0:1782241169.310353:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119949312 00000100:00100000:2.0:1782241169.310432:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119949184 00000100:00100000:2.0:1782241169.310435:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119949184 00000100:00100000:2.0:1782241169.310462:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 69 00000100:00100000:2.0:1782241169.310474:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119949312:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241169.310564:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119949312:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 93us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241169.310573:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 69 00000100:00100000:2.0:1782241169.310590:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 70 00000100:00100000:2.0:1782241169.310597:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2398:x1868815119949184:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241169.310617:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2398:x1868815119949184:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 21us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241169.310623:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 70 00000100:00100000:1.0:1782241169.310973:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119949056 00000100:00100000:1.0:1782241169.310978:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119949056 00000100:00100000:1.0:1782241169.311026:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 276 00000100:00100000:1.0:1782241169.311034:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2398:x1868815119949056:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241169.311069:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2398:x1868815119949056:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 37us (2964us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241169.311075:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 276 00000100:00100000:1.0:1782241169.311110:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119949568 00000100:00100000:1.0:1782241169.311114:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119949568 00000100:00100000:1.0:1782241169.311140:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119949440 00000100:00100000:1.0:1782241169.311143:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119949440 00000100:00100000:1.0:1782241169.311175:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:1.0:1782241169.311181:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119949568:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241169.311221:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119949568:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 40us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241169.311228:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:1.0:1782241169.311240:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:1.0:1782241169.311245:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119949440:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241169.311266:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119949440:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 21us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241169.311272:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00080000:3.0:1782241169.311718:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782241169.311723:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782241169.311726:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782241169.311729:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1782241170.052934:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241170.697460:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241170.697491:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139934336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782241170.697588:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241170.697697:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139934336 00000100:00100000:2.0:1782241170.697707:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139934336 00000100:00100000:3.0:1782241170.703852:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241170.703883:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139934464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241170.703977:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241170.704050:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139934464 00000100:00100000:3.0:1782241170.704060:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139934464 00000100:00100000:2.0:1782241170.704489:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782241170.704501:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139934336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782241170.704541:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241170.704614:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139934336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (7026us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241170.704622:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1782241170.707480:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47857800 x1868815139934336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241170.707517:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139934336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241170.707849:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782241170.707863:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139934464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782241170.707894:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241170.708102:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139934464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 242us (4124us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241170.708122:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1782241170.708152:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782241170.708194:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e778ded80 x1868815139934464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241170.708211:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139934464:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782241171.077290:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241172.100960:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241172.741565:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782241172.741597:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139934592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782241172.741693:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241172.742340:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139934592 00000100:00100000:0.0:1782241172.742351:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139934592 00000100:00100000:0.0:1782241172.742431:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782241172.742443:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139934592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241172.742499:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782241172.742590:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139934592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241172.742599:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782241172.742655:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139934592:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1782241172.941968:0:10688:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1782241173.124883:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241173.765742:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139935104:0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.765879:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241173.766217:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782241173.766230:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139934720:0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.766270:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241173.766301:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139935232:0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.766331:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241173.766370:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139935104 00000100:00100000:2.0:1782241173.766380:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139935104 00000100:00100000:2.0:1782241173.766439:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782241173.766449:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139935104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.766514:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139935104:12345-0@lo:400:kworker.0 Request processed in 65us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241173.766530:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782241173.767554:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139934848:0@lo:400:kworker.0 00000100:00100000:1.0:1782241173.767700:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139934976:0@lo:400:kworker.0 00000100:00100000:1.0:1782241173.767745:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241173.768275:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241173.768300:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139935360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241173.768323:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241173.768357:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139935360 00000100:00100000:3.0:1782241173.768364:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139935360 00000100:00100000:3.0:1782241173.768418:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782241173.768429:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139935360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782241173.768464:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241173.768510:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139935360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241173.768517:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1782241173.768542:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782241173.768579:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47857800 x1868815139935360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241173.768691:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139934720 00000100:00100000:2.0:1782241173.768696:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139934720 00000100:00100000:2.0:1782241173.768735:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1782241173.768743:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139934720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.768804:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139934720:12345-0@lo:400:kworker.0 Request processed in 62us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241173.768811:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1782241173.768848:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139935232 00000100:00100000:2.0:1782241173.768852:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139935232 00000100:00100000:2.0:1782241173.768876:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139934976 00000100:00100000:2.0:1782241173.768878:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139934976 00000100:00100000:2.0:1782241173.768891:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782241173.768896:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139935232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.768942:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139935232:12345-0@lo:400:kworker.0 Request processed in 34us (2599us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241173.768950:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782241173.768960:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782241173.768965:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139934976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.769256:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139934976:12345-0@lo:400:kworker.0 Request processed in 290us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241173.769263:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782241173.769284:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139934848 00000100:00100000:2.0:1782241173.769288:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139934848 00000100:00100000:2.0:1782241173.769317:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782241173.769323:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139934848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.769375:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139934848:12345-0@lo:400:kworker.0 Request processed in 51us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241173.769381:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782241173.769420:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139935488:0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.769450:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241173.769490:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139936000:0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.769510:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241173.769543:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139934976:0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.769564:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241173.769569:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139935872:0@lo:400:kworker.0 00000100:00100000:3.0:1782241173.769873:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139935360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241173.769895:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139934848:0@lo:400:kworker.0 00000100:00100000:0.0:1782241173.770032:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139935488 00000100:00100000:0.0:1782241173.770037:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139935488 00000100:00100000:0.0:1782241173.770081:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139936000 00000100:00100000:0.0:1782241173.770091:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139936000 00000100:00100000:0.0:1782241173.770115:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782241173.770123:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139935488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241173.770183:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139935488:12345-0@lo:400:kworker.0 Request processed in 61us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241173.770190:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782241173.770203:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782241173.770208:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139936000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241173.770236:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139936000:12345-0@lo:400:kworker.0 Request processed in 28us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241173.770242:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1782241173.770261:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241173.770283:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241173.770326:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139935488:0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.770338:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139936000:0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.770441:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139935616:0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.770536:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241173.770543:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139935872 00000100:00100000:0.0:1782241173.770548:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139935872 00000100:00100000:2.0:1782241173.770562:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815139936128:0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.770588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241173.770665:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782241173.770673:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139935872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241173.770709:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139935872:12345-0@lo:400:kworker.0 Request processed in 39us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241173.770715:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1782241173.770732:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241173.770738:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139935616 00000100:00100000:0.0:1782241173.770740:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139935616 00000100:00100000:0.0:1782241173.770780:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139936128 00000100:00100000:0.0:1782241173.770782:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139936128 00000100:00100000:0.0:1782241173.770795:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782241173.770799:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139935616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241173.770827:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139935616:12345-0@lo:400:kworker.0 Request processed in 27us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241173.770832:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782241173.770841:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782241173.770845:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815139936128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241173.770865:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815139936128:12345-0@lo:400:kworker.0 Request processed in 20us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241173.770870:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1782241173.770880:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1782241173.770895:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9a680 x1868815139935872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241173.770907:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139935872:0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.771730:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139934720:0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.771781:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139935232:0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.771799:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139935104:0@lo:400:kworker.0 00010000:00080000:2.0:1782241173.771835:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9ad80 x1868815139935616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241173.771866:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139935616:0@lo:400:kworker.0 00010000:00080000:2.0:1782241173.771881:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9bb80 x1868815139936128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241173.771890:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815139936128:0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.771904:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782241173.771913:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139935744:0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.771958:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241173.772011:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139936256:0@lo:400:kworker.0 00000100:00100000:2.0:1782241173.772035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241173.772166:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139935744 00000100:00100000:0.0:1782241173.772174:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139935744 00000100:00100000:0.0:1782241173.772231:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139936256 00000100:00100000:0.0:1782241173.772241:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139936256 00000100:00100000:0.0:1782241173.772268:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782241173.772276:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139935744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241173.772334:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139935744:12345-0@lo:400:kworker.0 Request processed in 59us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241173.772341:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782241173.772370:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782241173.772376:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139936256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241173.772412:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139936256:12345-0@lo:400:kworker.0 Request processed in 36us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241173.772418:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1782241173.773230:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782241173.773238:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782241173.773279:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9b100 x1868815139935744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241173.773292:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139935744:0@lo:400:kworker.0 00010000:00080000:2.0:1782241173.773304:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9aa00 x1868815139936256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241173.773312:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139936256:0@lo:400:kworker.0 00010000:00010000:1.0:1782241174.149166:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241174.277005:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241174.277030:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139936384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241174.277111:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241174.277339:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139936384 00000100:00100000:0.0:1782241174.277348:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139936384 00000100:00100000:0.0:1782241174.277401:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782241174.277410:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139936384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241174.277433:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241174.277502:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139936384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241174.277510:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1782241174.277587:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9a680 x1868815139936384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241174.277607:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139936384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241174.279289:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139936512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241174.279454:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241174.279631:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139936512 00000100:00100000:2.0:1782241174.279641:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139936512 00000100:00100000:2.0:1782241174.279703:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782241174.279714:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139936512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782241174.279787:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782241174.279930:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139936512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241174.280320:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139936512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 605us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241174.280335:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782241174.427262:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241174.427307:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241174.427425:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241174.427426:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119949696 00000100:00100000:1.0:1782241174.427452:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119949696 00000100:00100000:3.0:1782241174.427486:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241174.427891:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241174.427931:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119949952 00000100:00100000:0.0:1782241174.427942:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119949952 00000100:00100000:0.0:1782241174.428068:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119949824 00000100:00100000:0.0:1782241174.428072:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119949824 00000100:00100000:0.0:1782241174.428108:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 77 00000100:00100000:0.0:1782241174.428119:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119949952:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241174.428221:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119949952:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 103us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241174.428229:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 77 00000100:00100000:0.0:1782241174.428248:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 78 00000100:00100000:0.0:1782241174.428256:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119949824:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241174.428281:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119949824:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 26us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241174.428288:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 78 00000100:00100000:0.0:1782241174.428305:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119950208 00000100:00100000:0.0:1782241174.428308:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119950208 00000100:00100000:0.0:1782241174.428332:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119950080 00000100:00100000:0.0:1782241174.428335:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119950080 00000100:00100000:0.0:1782241174.428354:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 28 00000100:00100000:0.0:1782241174.428360:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119950208:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241174.428383:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119950208:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 23us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241174.428575:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 28 00000100:00100000:0.0:1782241174.428591:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00100000:0.0:1782241174.428597:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119950080:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241174.428622:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119950080:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 26us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241174.428641:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00080000:0.0:1782241174.428685:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782241174.428689:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782241174.428692:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241174.428700:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782241174.428715:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 278 00000100:00100000:0.0:1782241174.428723:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2399:x1868815119949696:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241174.428750:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2399:x1868815119949696:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 28us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241174.428788:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 278 00010000:00010000:3.0:1782241175.173009:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241175.812947:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782241175.812970:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139936640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241175.813040:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241175.813105:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139936640 00000100:00100000:3.0:1782241175.813113:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139936640 00000100:00100000:3.0:1782241175.813180:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782241175.813191:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139936640:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1782241175.813212:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1782241175.813220:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241175.816534:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139936640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3336us (3484us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241175.816548:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1782241175.816609:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476ec700 x1868815139936640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241175.816631:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139936640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241175.818125:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139936768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241175.818187:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241175.818618:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139936768 00000100:00100000:2.0:1782241175.818627:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139936768 00000100:00100000:2.0:1782241175.818693:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782241175.818778:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139936768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782241175.818801:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1782241175.818884:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241175.824215:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139936768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5449us (6017us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241175.824229:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1782241175.827842:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a99880 x1868815139936768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241175.827868:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139936768:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782241176.198052:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241177.222453:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782241177.679215:0:10931:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing yml_node 00000100:00100000:2.0:1782241177.863989:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241177.864012:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139936896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782241177.864092:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241177.864151:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139936896 00000100:00100000:0.0:1782241177.864160:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139936896 00000100:00100000:0.0:1782241177.864227:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782241177.864237:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139936896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241177.864272:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782241177.864352:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139936896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241177.864360:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782241177.864450:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139936896:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782241178.244994:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241178.885180:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139937024:0@lo:400:kworker.0 00000100:00100000:2.0:1782241178.885287:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241178.885355:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139937536:0@lo:400:kworker.0 00000100:00100000:2.0:1782241178.885410:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241178.885432:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139938048:0@lo:400:kworker.0 00000100:00100000:2.0:1782241178.885453:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241178.885469:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139938560:0@lo:400:kworker.0 00000100:00100000:2.0:1782241178.885488:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241178.885510:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1782241178.885516:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139937408:0@lo:400:kworker.0 00000100:00100000:2.0:1782241178.885537:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241178.885554:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139937920:0@lo:400:kworker.0 00000100:00100000:2.0:1782241178.885585:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241178.885604:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139938432:0@lo:400:kworker.0 00000100:00100000:2.0:1782241178.885625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241178.885661:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139937536 00000100:00100000:2.0:1782241178.885668:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139937536 00000100:00100000:1.0:1782241178.886277:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815139937152:0@lo:400:kworker.0 00000100:00100000:1.0:1782241178.886310:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241178.886329:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815139937664:0@lo:400:kworker.0 00000100:00100000:1.0:1782241178.886349:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241178.886363:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815139938176:0@lo:400:kworker.0 00000100:00100000:1.0:1782241178.886381:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241178.886411:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782241178.886417:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139937280:0@lo:400:kworker.0 00000100:00100000:1.0:1782241178.886437:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241178.886451:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139937792:0@lo:400:kworker.0 00000100:00100000:1.0:1782241178.886467:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241178.886476:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815139938304:0@lo:400:kworker.0 00000100:00100000:1.0:1782241178.886495:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241178.886832:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139938048 00000100:00100000:3.0:1782241178.886838:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139938048 00000100:00100000:3.0:1782241178.886894:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139938560 00000100:00100000:3.0:1782241178.886906:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139938560 00000100:00100000:3.0:1782241178.886922:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139937920 00000100:00100000:3.0:1782241178.886924:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139937920 00000100:00100000:3.0:1782241178.886935:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139938432 00000100:00100000:3.0:1782241178.886937:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139938432 00000100:00100000:3.0:1782241178.886952:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782241178.886960:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139938048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241178.887028:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139938048:12345-0@lo:400:kworker.0 Request processed in 69us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241178.887036:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782241178.887055:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782241178.887061:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139938560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241178.887090:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139938560:12345-0@lo:400:kworker.0 Request processed in 29us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241178.887096:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782241178.887107:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782241178.887112:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139937920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241178.887139:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139937920:12345-0@lo:400:kworker.0 Request processed in 26us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241178.887145:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782241178.887267:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139937280 00000100:00100000:2.0:1782241178.887271:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139937280 00000100:00100000:2.0:1782241178.887289:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782241178.887296:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139937536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241178.887336:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139937536:12345-0@lo:400:kworker.0 Request processed in 41us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241178.887341:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782241178.887353:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782241178.887358:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139937280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241178.887632:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139937024 00000100:00100000:0.0:1782241178.887637:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139937024 00000100:00100000:0.0:1782241178.887677:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1782241178.887683:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815139937024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241178.888002:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782241178.888026:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139938688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241178.888085:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782241178.888093:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139938432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241178.888220:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815139937024:12345-0@lo:400:kworker.0 Request processed in 536us (2933us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241178.888227:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1782241178.888266:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139937408 00000100:00100000:0.0:1782241178.888270:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139937408 00000100:00100000:0.0:1782241178.888289:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139937152 00000100:00100000:0.0:1782241178.888291:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139937152 00000100:00100000:0.0:1782241178.888302:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139937664 00000100:00100000:0.0:1782241178.888305:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139937664 00000100:00100000:0.0:1782241178.888329:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139938176 00000100:00100000:0.0:1782241178.888332:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139938176 00000100:00100000:0.0:1782241178.888342:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139937792 00000100:00100000:0.0:1782241178.888345:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139937792 00000100:00100000:0.0:1782241178.888355:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139938304 00000100:00100000:0.0:1782241178.888358:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139938304 00000100:00100000:0.0:1782241178.888371:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1782241178.888376:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139937408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241178.888414:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139937408:12345-0@lo:400:kworker.0 Request processed in 38us (2876us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241178.888421:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1782241178.888431:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1782241178.888437:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815139937152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241178.888464:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815139937152:12345-0@lo:400:kworker.0 Request processed in 28us (2153us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241178.888470:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1782241178.888481:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782241178.888486:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815139937664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241178.888514:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815139937664:12345-0@lo:400:kworker.0 Request processed in 28us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241178.888520:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782241178.888529:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782241178.888534:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815139938176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241178.888578:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815139938176:12345-0@lo:400:kworker.0 Request processed in 43us (2195us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241178.888583:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782241178.888594:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782241178.888604:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139937792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241178.888651:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139937792:12345-0@lo:400:kworker.0 Request processed in 47us (2183us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241178.888657:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782241178.888669:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782241178.888674:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815139938304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241178.888718:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815139938304:12345-0@lo:400:kworker.0 Request processed in 44us (2222us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241178.888724:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782241178.888821:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139937280:0@lo:400:kworker.0 00010000:00080000:0.0:1782241178.888837:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9b800 x1868815139937792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241178.888847:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139937792:0@lo:400:kworker.0 00010000:00080000:0.0:1782241178.888857:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9a680 x1868815139938304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241178.888879:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815139938304:0@lo:400:kworker.0 00000100:00100000:0.0:1782241178.888891:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815139937152:0@lo:400:kworker.0 00000100:00100000:0.0:1782241178.888901:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815139937664:0@lo:400:kworker.0 00000100:00100000:0.0:1782241178.888910:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815139938176:0@lo:400:kworker.0 00000100:00080000:0.0:1782241178.888954:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241178.888959:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241178.888961:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782241178.888964:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241178.888996:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139937408:0@lo:400:kworker.0 00010000:00080000:0.0:1782241178.889019:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a99f80 x1868815139937920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241178.889029:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139937920:0@lo:400:kworker.0 00000100:00100000:0.0:1782241178.889039:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139937024:0@lo:400:kworker.0 00000100:00100000:0.0:1782241178.889049:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139937536:0@lo:400:kworker.0 00010000:00080000:0.0:1782241178.889060:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a98a80 x1868815139938048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241178.889066:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139938048:0@lo:400:kworker.0 00010000:00080000:0.0:1782241178.889076:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9b100 x1868815139938560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241178.889083:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139938560:0@lo:400:kworker.0 00000100:00100000:1.0:1782241178.889597:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241178.889845:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139938432:12345-0@lo:400:kworker.0 Request processed in 1751us (4217us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241178.889854:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1782241178.889904:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9aa00 x1868815139938432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241178.889927:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139938432:0@lo:400:kworker.0 00000100:00100000:0.0:1782241178.890069:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139938688 00000100:00100000:0.0:1782241178.890076:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139938688 00000100:00100000:0.0:1782241178.890117:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782241178.890125:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139938688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782241178.890150:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241178.890213:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139938688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241178.890219:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1782241178.890348:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a27800 x1868815139938688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241178.890362:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139938688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241178.890773:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139937280:12345-0@lo:400:kworker.0 Request processed in 3289us (4209us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241178.890784:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:3.0:1782241179.268952:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241179.396985:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241179.397020:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139938816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241179.397053:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241179.397063:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139938944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241179.397090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241179.397090:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241179.397182:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139938816 00000100:00100000:2.0:1782241179.397191:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139938816 00000100:00100000:1.0:1782241179.397208:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139938944 00000100:00100000:1.0:1782241179.397214:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139938944 00000100:00100000:2.0:1782241179.397243:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782241179.397255:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782241179.397257:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139938816:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241179.397268:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139938944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782241179.397288:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:2.0:1782241179.397295:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782241179.397461:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139938816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 208us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241179.397469:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782241179.397554:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139938816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241179.399882:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139938944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2609us (2782us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241179.399908:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1782241179.400104:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9b100 x1868815139938944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241179.400126:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139938944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241179.563624:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241179.563671:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241179.563706:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241179.563747:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241179.563829:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241179.563853:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119950464 00000100:00100000:2.0:1782241179.563862:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119950464 00000100:00100000:2.0:1782241179.563937:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119950592 00000100:00100000:2.0:1782241179.563941:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119950592 00000100:00100000:2.0:1782241179.563965:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 85 00000100:00100000:2.0:1782241179.563975:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119950464:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241179.564069:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119950464:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 94us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241179.564077:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 85 00000100:00100000:2.0:1782241179.564094:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 86 00000100:00100000:2.0:1782241179.564101:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119950592:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241179.564102:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119950336 00000100:00100000:3.0:1782241179.564107:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119950336 00000100:00100000:2.0:1782241179.564127:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119950592:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 26us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241179.564133:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 86 00000100:00100000:3.0:1782241179.564393:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 280 00000100:00100000:3.0:1782241179.564402:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2398:x1868815119950336:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241179.564435:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2398:x1868815119950336:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 35us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241179.564441:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 280 00000100:00100000:0.0:1782241179.564731:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119950720 00000100:00100000:0.0:1782241179.564737:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119950720 00000100:00100000:0.0:1782241179.566032:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119950848 00000100:00100000:0.0:1782241179.566041:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119950848 00000100:00100000:0.0:1782241179.566082:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:0.0:1782241179.566092:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2395:x1868815119950720:12345-192.168.204.58@tcp:9:kworker.0 00000020:00000080:0.0:1782241179.566129:0:8425:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e196d1 00000100:00080000:0.0:1782241179.566139:0:8425:0:(import.c:65:import_set_state_nolock()) ffff890d47590800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782241179.566184:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1782241179.566371:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:2.0:1782241179.566393:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2395:x1868815119950848:12345-192.168.204.58@tcp:9:kworker.0 00000020:00000080:2.0:1782241179.566414:0:8747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e196d8 00000100:00080000:2.0:1782241179.566421:0:8747:0:(import.c:65:import_set_state_nolock()) ffff890d469bf000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782241179.566463:0:8747:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1782241179.566605:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+2:2395:x1868815119950848:12345-192.168.204.58@tcp:9:kworker.0 Request processed in 225us (2774us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241179.566613:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 19 00010000:00010000:2.0:1782241179.566635:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241179.566703:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782241179.567694:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241179.567701:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782241179.567704:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241179.567706:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241179.568462:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+2:2395:x1868815119950720:12345-192.168.204.58@tcp:9:kworker.0 Request processed in 2365us (4707us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241179.568473:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 18 00010000:00010000:1.0:1782241180.292920:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241180.938052:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241180.938074:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139939072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782241180.938151:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241180.938235:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139939072 00000100:00100000:0.0:1782241180.938242:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139939072 00000100:00100000:0.0:1782241180.938294:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782241180.938303:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139939072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782241180.938331:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241180.938379:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139939072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241180.938398:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1782241180.938419:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782241180.938450:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9b100 x1868815139939072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241180.938467:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139939072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782241180.943629:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782241180.943858:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139939200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241180.943936:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241180.944035:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139939200 00000100:00100000:0.0:1782241180.944044:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139939200 00000100:00100000:0.0:1782241180.944133:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782241180.944143:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139939200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782241180.944166:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241180.944246:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139939200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241180.944253:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1782241180.944496:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47850e00 x1868815139939200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241180.944516:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139939200:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1782241180.944601:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782241181.318006:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782241181.709359:0:11115:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00010000:00010000:3.0:1782241182.347881:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241182.980972:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782241182.981003:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139939328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782241182.982624:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241182.983092:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139939328 00000100:00100000:2.0:1782241182.983107:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139939328 00000100:00100000:2.0:1782241182.983341:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782241182.983354:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139939328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782241182.983391:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782241182.983468:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139939328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241182.983475:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782241182.983532:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139939328:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782241183.365446:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241184.005960:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139939456:0@lo:400:kworker.0 00000100:00100000:0.0:1782241184.006035:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241184.006129:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139939968:0@lo:400:kworker.0 00000100:00100000:0.0:1782241184.006180:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241184.006202:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139940480:0@lo:400:kworker.0 00000100:00100000:0.0:1782241184.006225:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241184.006246:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139940992:0@lo:400:kworker.0 00000100:00100000:1.0:1782241184.006255:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139939456 00000100:00100000:1.0:1782241184.006262:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139939456 00000100:00100000:0.0:1782241184.006265:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241184.006289:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782241184.006294:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139939584:0@lo:400:kworker.0 00000100:00100000:1.0:1782241184.006306:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1782241184.006315:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815139939456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241184.006336:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241184.006356:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139940096:0@lo:400:kworker.0 00000100:00100000:1.0:1782241184.006365:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815139939456:12345-0@lo:400:kworker.0 Request processed in 51us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241184.006372:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1782241184.006376:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241184.006392:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815139940608:0@lo:400:kworker.0 00000100:00100000:1.0:1782241184.006420:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139939584 00000100:00100000:0.0:1782241184.006423:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241184.006424:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139939584 00000100:00100000:1.0:1782241184.006445:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139940096 00000100:00100000:1.0:1782241184.006448:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139940096 00000100:00100000:0.0:1782241184.006454:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139939456:0@lo:400:kworker.0 00000100:00100000:1.0:1782241184.006466:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139940608 00000100:00100000:1.0:1782241184.006469:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139940608 00000100:00100000:0.0:1782241184.006478:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782241184.006485:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139939584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241184.006526:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139939584:12345-0@lo:400:kworker.0 Request processed in 41us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241184.007466:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139939712:0@lo:400:kworker.0 00000100:00100000:2.0:1782241184.007506:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241184.007544:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139940224:0@lo:400:kworker.0 00000100:00100000:2.0:1782241184.007560:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241184.007570:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815139940736:0@lo:400:kworker.0 00000100:00100000:2.0:1782241184.007584:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241184.007597:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1782241184.007609:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139939840:0@lo:400:kworker.0 00000100:00100000:2.0:1782241184.007626:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241184.007637:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139940352:0@lo:400:kworker.0 00000100:00100000:1.0:1782241184.007867:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139940224 00000100:00100000:1.0:1782241184.007878:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139940224 00000100:00100000:1.0:1782241184.007900:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139940736 00000100:00100000:1.0:1782241184.007902:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139940736 00000100:00100000:1.0:1782241184.007925:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139939840 00000100:00100000:1.0:1782241184.007927:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139939840 00000100:00100000:1.0:1782241184.007940:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782241184.007946:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139940096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241184.007983:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139940096:12345-0@lo:400:kworker.0 Request processed in 36us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241184.007989:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782241184.008002:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782241184.008007:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815139940608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241184.008026:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815139940608:12345-0@lo:400:kworker.0 Request processed in 19us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241184.008031:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782241184.008368:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139940480 00000100:00100000:3.0:1782241184.008373:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139940480 00000100:00100000:3.0:1782241184.008459:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139940992 00000100:00100000:3.0:1782241184.008462:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139940992 00000100:00100000:3.0:1782241184.008485:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782241184.008491:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139940480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241184.008530:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139940480:12345-0@lo:400:kworker.0 Request processed in 39us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241184.008535:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782241184.008559:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782241184.008565:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139940992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241184.008595:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139940992:12345-0@lo:400:kworker.0 Request processed in 30us (2329us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241184.008600:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782241184.008657:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139941120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241184.008780:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241184.008873:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782241184.008881:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139940224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241184.008948:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139940864:0@lo:400:kworker.0 00000100:00100000:2.0:1782241184.008974:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241184.009010:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139939968 00000100:00100000:2.0:1782241184.009015:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139939968 00000100:00100000:2.0:1782241184.009177:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139939712 00000100:00100000:2.0:1782241184.009181:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139939712 00000100:00100000:2.0:1782241184.009197:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782241184.009203:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139939968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241184.009393:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139939968:12345-0@lo:400:kworker.0 Request processed in 188us (3211us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241184.009399:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782241184.009413:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782241184.009419:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139939712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241184.009456:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139939712:12345-0@lo:400:kworker.0 Request processed in 38us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241184.009461:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782241184.009478:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139940352 00000100:00100000:2.0:1782241184.009481:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139940352 00000100:00100000:2.0:1782241184.009502:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139940864 00000100:00100000:2.0:1782241184.009505:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139940864 00000100:00100000:2.0:1782241184.009516:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782241184.009521:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139940352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241184.009550:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139940352:12345-0@lo:400:kworker.0 Request processed in 29us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241184.009563:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782241184.009573:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782241184.009579:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139940864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241184.009608:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139940864:12345-0@lo:400:kworker.0 Request processed in 30us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241184.009614:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782241184.009632:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1782241184.009640:0:6512:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1782241184.009656:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1782241184.009662:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782241184.009668:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815139940736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241184.009814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1782241184.009925:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9a680 x1868815139940352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241184.009941:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139940352:0@lo:400:kworker.0 00010000:00080000:3.0:1782241184.009956:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9ad80 x1868815139940864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241184.009964:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139940864:0@lo:400:kworker.0 00000100:00100000:3.0:1782241184.009974:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139939712:0@lo:400:kworker.0 00000100:00100000:1.0:1782241184.010211:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139940224:12345-0@lo:400:kworker.0 Request processed in 1329us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241184.010218:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:3.0:1782241184.010393:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a98e00 x1868815139940224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241184.010404:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139940224:0@lo:400:kworker.0 00000100:00100000:3.0:1782241184.010442:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139941120 00000100:00100000:3.0:1782241184.010447:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139941120 00000100:00100000:3.0:1782241184.010485:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782241184.010492:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139941120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782241184.010515:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241184.010556:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139941120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241184.010570:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1782241184.010596:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77a57800 x1868815139941120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241184.010608:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139941120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241184.010643:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782241184.010651:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139939840:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782241184.010833:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241184.010837:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782241184.010840:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241184.010843:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241184.010956:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139939584:0@lo:400:kworker.0 00000100:00100000:1.0:1782241184.010970:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139940096:0@lo:400:kworker.0 00000100:00100000:1.0:1782241184.010980:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815139940608:0@lo:400:kworker.0 00000100:00100000:1.0:1782241184.011000:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139939968:0@lo:400:kworker.0 00010000:00080000:1.0:1782241184.011010:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9b800 x1868815139940480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241184.011019:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139940480:0@lo:400:kworker.0 00010000:00080000:1.0:1782241184.011033:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a99500 x1868815139940992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241184.011041:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139940992:0@lo:400:kworker.0 00000100:00100000:0.0:1782241184.016048:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782241184.017427:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815139940736:12345-0@lo:400:kworker.0 Request processed in 7750us (9832us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241184.017443:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782241184.017535:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139939840:0@lo:400:kworker.0 00010000:00080000:2.0:1782241184.017550:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9bb80 x1868815139940736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241184.017560:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815139940736:0@lo:400:kworker.0 00000100:00100000:3.0:1782241184.018533:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139939840:12345-0@lo:400:kworker.0 Request processed in 7878us (10900us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241184.018545:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000001:02000400:2.0:1782241184.344589:0:11213:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00010000:00010000:1.0:1782241184.388953:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241184.518152:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139941248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241184.518315:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241184.518714:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139941248 00000100:00100000:3.0:1782241184.518721:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139941248 00000100:00100000:3.0:1782241184.518778:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782241184.518787:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139941248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782241184.518810:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241184.518854:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139941248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241184.518860:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1782241184.518912:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77a57800 x1868815139941248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241184.518939:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139941248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241184.523022:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782241184.523046:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139941376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241184.524470:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241184.524604:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139941376 00000100:00100000:1.0:1782241184.524613:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139941376 00000100:00100000:1.0:1782241184.524671:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782241184.524680:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139941376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241184.524712:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241184.524775:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139941376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241184.524782:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782241184.524875:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139941376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241184.667207:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241184.667254:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241184.667290:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241184.667323:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119950976 00000100:00100000:3.0:1782241184.667332:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119950976 00000100:00100000:3.0:1782241184.667379:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 282 00000100:00100000:3.0:1782241184.667389:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2397:x1868815119950976:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241184.667411:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119951104 00000100:00100000:1.0:1782241184.667417:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119951104 00000100:00100000:3.0:1782241184.667461:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2397:x1868815119950976:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241184.667464:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119951232 00000100:00100000:1.0:1782241184.667468:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119951232 00000100:00100000:3.0:1782241184.667475:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 282 00000100:00100000:1.0:1782241184.667501:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 93 00000100:00100000:1.0:1782241184.667512:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2397:x1868815119951104:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241184.667527:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 94 00000100:00100000:3.0:1782241184.667538:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815119951232:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241184.667550:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2397:x1868815119951104:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 40us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241184.667559:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 93 00000100:00100000:3.0:1782241184.667575:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815119951232:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 38us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241184.667583:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 94 00000100:00080000:1.0:1782241184.667607:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241184.667612:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782241185.414120:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782241185.543888:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000020:00000080:0.0:1782241185.543899:0:8419:0:(genops.c:906:class_export_put()) final put ffff890d47590000/8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000020:00000080:1.0:1782241185.543969:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47590000/8052d7b9-50cc-405f-b8e0-5c9d863c1c52 for lustre-OST0000 00000020:00000080:1.0:1782241185.544023:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d47590800 for lustre-OST0000 00000001:00100000:2.0:1782241185.544487:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000020:00000080:2.0:1782241185.544501:0:9506:0:(genops.c:906:class_export_put()) final put ffff890d469be000/8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000020:00000080:3.0:1782241185.544565:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff890d469be000/8052d7b9-50cc-405f-b8e0-5c9d863c1c52 for lustre-OST0001 00000020:00000080:3.0:1782241185.544604:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d469bf000 for lustre-OST0001 00000100:00100000:1.0:1782241186.053108:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139941504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782241186.053181:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241186.053303:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139941504 00000100:00100000:0.0:1782241186.053312:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139941504 00000100:00100000:0.0:1782241186.053428:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782241186.053439:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139941504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782241186.053471:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241186.053545:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139941504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241186.053552:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1782241186.053598:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782241186.053636:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9bb80 x1868815139941504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241186.053654:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139941504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241186.054514:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139941632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241186.054550:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241186.054606:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139941632 00000100:00100000:0.0:1782241186.054612:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139941632 00000100:00100000:0.0:1782241186.054648:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782241186.054655:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139941632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782241186.054684:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1782241186.054738:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241186.055342:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139941632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 685us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241186.055349:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1782241186.055402:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793ce00 x1868815139941632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241186.055417:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139941632:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1782241186.440568:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782241186.896940:0:11311:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00010000:00010000:2.0:1782241187.461026:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241188.106688:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782241188.106722:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139941760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241188.106841:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241188.106938:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139941760 00000100:00100000:1.0:1782241188.106946:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139941760 00000100:00100000:1.0:1782241188.107001:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782241188.107012:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139941760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782241188.107051:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1782241188.107106:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139941760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241188.107114:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782241188.107168:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139941760:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782241188.484936:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782241188.561926:0:11359:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Jun 23 14:59:47 EDT 2026 00000100:00100000:2.0:1782241189.125231:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139941888:0@lo:400:kworker.0 00000100:00100000:2.0:1782241189.125353:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241189.125668:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139941888 00000100:00100000:3.0:1782241189.125679:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139941888 00000100:00100000:3.0:1782241189.125746:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1782241189.125783:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139941888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.126517:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139941888:12345-0@lo:400:kworker.0 Request processed in 733us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241189.126528:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1782241189.126640:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139942016:0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.126687:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139942272:0@lo:400:kworker.0 00000100:00100000:1.0:1782241189.126689:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241189.126728:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241189.126733:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139942528:0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.126782:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139942784:0@lo:400:kworker.0 00000100:00100000:1.0:1782241189.126783:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241189.126822:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815139943040:0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.126829:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241189.126851:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241189.126856:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139943296:0@lo:400:kworker.0 00000100:00100000:1.0:1782241189.126879:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139943424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241189.126887:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241189.126913:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241189.126916:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782241189.126925:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139942400:0@lo:400:kworker.0 00000100:00100000:1.0:1782241189.126939:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782241189.126948:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139942144:0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.126956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241189.126978:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241189.126982:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139942912:0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.127072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241189.127090:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139943552:0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.127109:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241189.127141:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139942016 00000100:00100000:3.0:1782241189.127149:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139942016 00000100:00100000:1.0:1782241189.127157:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139942656:0@lo:400:kworker.0 00000100:00100000:1.0:1782241189.127187:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241189.127189:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139942272 00000100:00100000:3.0:1782241189.127193:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139942272 00000100:00100000:1.0:1782241189.127200:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815139943168:0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.127211:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139942528 00000100:00100000:3.0:1782241189.127215:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139942528 00000100:00100000:1.0:1782241189.127226:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241189.127246:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139943040 00000100:00100000:3.0:1782241189.127250:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139943040 00000100:00100000:1.0:1782241189.127259:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139942656 00000100:00100000:1.0:1782241189.127265:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139942656 00000100:00100000:3.0:1782241189.127269:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139943168 00000100:00100000:3.0:1782241189.127274:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139943168 00000100:00100000:1.0:1782241189.127296:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782241189.127308:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139942016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.127314:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782241189.127324:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139942272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241189.127373:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139942016:12345-0@lo:400:kworker.0 Request processed in 55us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241189.127375:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139942272:12345-0@lo:400:kworker.0 Request processed in 53us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241189.127388:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782241189.127400:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782241189.127409:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782241189.127418:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139942528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.127423:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782241189.127434:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815139943040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241189.127455:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139942528:12345-0@lo:400:kworker.0 Request processed in 39us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241189.127463:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782241189.127474:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815139943040:12345-0@lo:400:kworker.0 Request processed in 42us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241189.127483:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782241189.127490:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782241189.127498:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139942656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.127504:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782241189.127514:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815139943168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241189.127541:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139942656:12345-0@lo:400:kworker.0 Request processed in 44us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241189.127549:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782241189.127556:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815139943168:12345-0@lo:400:kworker.0 Request processed in 43us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241189.127564:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782241189.127586:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139943424 00000100:00100000:3.0:1782241189.127591:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139942784 00000100:00100000:1.0:1782241189.127591:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139943424 00000100:00100000:3.0:1782241189.127598:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139942784 00000100:00100000:1.0:1782241189.127632:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782241189.127636:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139943296 00000100:00100000:1.0:1782241189.127641:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139943424:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241189.127642:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139943296 00000100:00100000:3.0:1782241189.127660:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139942912 00000100:00100000:3.0:1782241189.127664:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139942912 00002000:00000024:1.0:1782241189.127674:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241189.127677:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139943552 00000100:00100000:3.0:1782241189.127681:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139943552 00000100:00100000:3.0:1782241189.127695:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782241189.127703:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139942784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241189.127714:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815139943424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241189.127721:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782241189.127744:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139942400 00000100:00100000:3.0:1782241189.127746:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139942784:12345-0@lo:400:kworker.0 Request processed in 43us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241189.127788:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782241189.127802:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782241189.127819:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139943296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.127854:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139943296:12345-0@lo:400:kworker.0 Request processed in 46us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241189.127862:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782241189.127874:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782241189.127881:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139942912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.127909:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139942912:12345-0@lo:400:kworker.0 Request processed in 29us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241189.127915:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782241189.127926:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782241189.127933:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139943552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.127960:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139943552:12345-0@lo:400:kworker.0 Request processed in 28us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241189.127966:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1782241189.128096:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7785b100 x1868815139942912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241189.128112:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139942912:0@lo:400:kworker.0 00010000:00080000:3.0:1782241189.128123:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47830380 x1868815139943552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241189.128132:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139943552:0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.128144:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139942272:0@lo:400:kworker.0 00010000:00080000:3.0:1782241189.128164:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7785b800 x1868815139942784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241189.128173:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139942784:0@lo:400:kworker.0 00010000:00080000:3.0:1782241189.128183:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47831180 x1868815139943296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241189.128190:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139943296:0@lo:400:kworker.0 00000100:00100000:1.0:1782241189.128330:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139942400 00000100:00100000:3.0:1782241189.128358:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139942144 00000100:00100000:3.0:1782241189.128364:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139942144 00000100:00100000:1.0:1782241189.128444:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782241189.128452:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782241189.128457:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139942400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.128465:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139942144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241189.128513:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139942400:12345-0@lo:400:kworker.0 Request processed in 61us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241189.128520:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139942144:12345-0@lo:400:kworker.0 Request processed in 57us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241189.128523:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782241189.128534:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1782241189.128554:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782241189.128560:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241189.128563:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241189.128565:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782241189.128595:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139942144:0@lo:400:kworker.0 00000100:00100000:1.0:1782241189.128601:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139942400:0@lo:400:kworker.0 00010000:00080000:3.0:1782241189.128615:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77858a80 x1868815139942656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241189.128626:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139942656:0@lo:400:kworker.0 00010000:00080000:3.0:1782241189.128640:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47831500 x1868815139943168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241189.128648:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815139943168:0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.128660:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139942016:0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.128670:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139942528:0@lo:400:kworker.0 00000100:00100000:3.0:1782241189.128701:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815139943040:0@lo:400:kworker.0 00010000:00080000:3.0:1782241189.128711:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77a56680 x1868815139943424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241189.128728:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139943424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241189.128774:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139941888:0@lo:400:kworker.0 00010000:00010000:0.0:1782241189.513892:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241189.637824:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139943680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241189.637928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241189.638131:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139943808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241189.638172:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241189.638270:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139943808 00000100:00100000:3.0:1782241189.638280:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139943808 00000100:00100000:3.0:1782241189.638347:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782241189.638359:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139943808:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241189.638388:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139943680 00002000:00000024:3.0:1782241189.638393:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241189.638395:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139943680 00000100:00100000:3.0:1782241189.639826:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139943808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1461us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241189.639840:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1782241189.639913:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a98380 x1868815139943808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241189.639938:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139943808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241189.640169:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782241189.640191:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139943680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782241189.640234:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782241189.648553:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139943680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8352us (10608us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241189.648574:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782241189.649294:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139943680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241189.789492:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241189.789645:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241189.789712:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241189.789754:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119951360 00000100:00100000:3.0:1782241189.789988:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119951360 00000100:00100000:3.0:1782241189.790050:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 284 00000100:00100000:3.0:1782241189.790061:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2396:x1868815119951360:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241189.790147:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2396:x1868815119951360:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 88us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241189.790156:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 284 00000100:00100000:0.0:1782241189.793675:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119951616 00000100:00100000:0.0:1782241189.793691:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119951616 00000100:00100000:1.0:1782241189.793917:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119951488 00000100:00100000:1.0:1782241189.793922:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119951488 00000100:00100000:1.0:1782241189.793980:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 101 00000100:00100000:1.0:1782241189.793991:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2396:x1868815119951488:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241189.794087:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2396:x1868815119951488:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 98us (4609us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241189.794096:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 101 00000100:00100000:1.0:1782241189.794433:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 102 00000100:00100000:1.0:1782241189.794440:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119951616:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241189.794512:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119951616:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 66us (4793us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241189.794519:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 102 00000100:00080000:3.0:1782241189.795135:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782241189.795141:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1782241190.533976:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241191.178931:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139943936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241191.179034:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241191.179158:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139943936 00000100:00100000:0.0:1782241191.179167:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139943936 00000100:00100000:0.0:1782241191.179232:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782241191.179242:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139943936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782241191.179281:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241191.179340:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139943936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241191.179349:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1782241191.179377:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782241191.179545:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9b800 x1868815139943936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241191.179570:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139943936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241191.180405:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139944064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782241191.180470:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241191.181481:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139944064 00000100:00100000:1.0:1782241191.181491:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139944064 00000100:00100000:1.0:1782241191.181558:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782241191.181569:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139944064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782241191.181598:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241191.181662:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139944064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241191.181670:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1782241191.181710:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782241191.181815:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9b800 x1868815139944064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241191.181839:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139944064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782241191.556898:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241192.580905:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241193.220969:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241193.221709:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139944192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241193.221827:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241193.221970:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139944192 00000100:00100000:1.0:1782241193.221978:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139944192 00000100:00100000:1.0:1782241193.222042:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782241193.222051:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139944192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782241193.222089:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1782241193.222157:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139944192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241193.222173:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782241193.222339:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139944192:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782241193.605564:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241194.244961:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139944320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782241194.245038:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241194.245105:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139944832:0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.245132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241194.245150:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139945344:0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.245171:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241194.245188:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139945856:0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.245204:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241194.245218:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1782241194.245224:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139944448:0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.245250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241194.245272:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139944960:0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.245295:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241194.245313:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139945472:0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.245352:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241194.245372:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139945984:0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.245392:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241194.245417:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139944704:0@lo:400:kworker.0 00000100:00100000:2.0:1782241194.245453:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139944960 00000100:00100000:1.0:1782241194.245453:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241194.245463:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139944960 00000100:00100000:1.0:1782241194.245476:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815139945216:0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.245501:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241194.245510:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139944704 00000100:00100000:2.0:1782241194.245515:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139944704 00000100:00100000:1.0:1782241194.245522:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815139945728:0@lo:400:kworker.0 00000100:00100000:2.0:1782241194.245538:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782241194.245548:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241194.245553:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139944960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.245570:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1782241194.245577:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139944576:0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.245597:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241194.245612:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139945088:0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.245630:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241194.245646:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139945600:0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.245665:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241194.245686:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139944320 00000100:00100000:1.0:1782241194.245690:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139944320 00000100:00100000:1.0:1782241194.245740:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782241194.245748:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139944320:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241194.245795:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139944960:12345-0@lo:400:kworker.0 Request processed in 246us (496us total) trans 0 rc 0/0 00002000:00000024:1.0:1782241194.245800:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241194.245807:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782241194.245828:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782241194.245836:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139944704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.245842:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139944320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241194.245854:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782241194.245877:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139945344 00000100:00100000:1.0:1782241194.245882:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139945344 00000100:00100000:1.0:1782241194.245909:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139945856 00000100:00100000:1.0:1782241194.245912:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139945856 00000100:00100000:1.0:1782241194.245924:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139945472 00000100:00100000:1.0:1782241194.245926:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139945472 00000100:00100000:1.0:1782241194.245938:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139945984 00000100:00100000:1.0:1782241194.245946:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139945984 00000100:00100000:1.0:1782241194.245963:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782241194.245969:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139945344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.246002:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139945344:12345-0@lo:400:kworker.0 Request processed in 33us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241194.246009:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782241194.246025:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139944704:12345-0@lo:400:kworker.0 Request processed in 188us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241194.246026:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782241194.246036:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139945856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241194.246038:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782241194.246072:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139945856:12345-0@lo:400:kworker.0 Request processed in 36us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241194.246079:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782241194.246095:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139944704:0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.246095:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782241194.246107:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139945472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241194.246137:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139944960:0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.246146:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139945472:12345-0@lo:400:kworker.0 Request processed in 40us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241194.246155:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1782241194.246156:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7785b480 x1868815139945472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241194.246168:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782241194.246175:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d995880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139945984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.246199:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d995880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139945984:12345-0@lo:400:kworker.0 Request processed in 25us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241194.246205:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782241194.246228:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139944448 00000100:00100000:1.0:1782241194.246231:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139944448 00000100:00100000:1.0:1782241194.246257:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1782241194.246264:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139944448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.246293:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139944448:12345-0@lo:400:kworker.0 Request processed in 30us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241194.246308:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1782241194.246348:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139944832 00000100:00100000:1.0:1782241194.246352:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139944832 00000100:00100000:1.0:1782241194.246368:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139945216 00000100:00100000:1.0:1782241194.246370:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139945216 00000100:00100000:1.0:1782241194.246381:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139945728 00000100:00100000:1.0:1782241194.246384:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139945728 00000100:00100000:1.0:1782241194.246395:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139944576 00000100:00100000:1.0:1782241194.246398:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139944576 00000100:00100000:1.0:1782241194.246411:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139945088 00000100:00100000:1.0:1782241194.246413:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139945088 00000100:00100000:1.0:1782241194.246431:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139945600 00000100:00100000:1.0:1782241194.246434:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139945600 00000100:00100000:3.0:1782241194.246438:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782241194.246449:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139944832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.246454:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782241194.246466:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815139945216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241194.246502:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139944832:12345-0@lo:400:kworker.0 Request processed in 55us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241194.246510:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782241194.246513:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139945472:0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.246520:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815139945216:12345-0@lo:400:kworker.0 Request processed in 55us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241194.246527:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1782241194.246529:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7785b800 x1868815139945984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241194.246534:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815139945728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241194.246538:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139945984:0@lo:400:kworker.0 00000100:00100000:2.0:1782241194.246549:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139944832:0@lo:400:kworker.0 00010000:00080000:2.0:1782241194.246560:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77858e00 x1868815139945344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241194.246564:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815139945728:12345-0@lo:400:kworker.0 Request processed in 30us (1017us total) trans 0 rc 0/0 00000100:00080000:0.0:1782241194.246811:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241194.246816:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241194.246818:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782241194.246820:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782241194.246866:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782241194.246881:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782241194.246888:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139944576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.246920:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139944576:12345-0@lo:400:kworker.0 Request processed in 33us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241194.246927:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782241194.246938:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782241194.246944:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139945088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.246969:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139945088:12345-0@lo:400:kworker.0 Request processed in 25us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241194.246975:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782241194.246995:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1782241194.247002:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139945600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241194.247028:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139945600:12345-0@lo:400:kworker.0 Request processed in 28us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241194.247034:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782241194.249374:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139945344:0@lo:400:kworker.0 00010000:00080000:2.0:1782241194.249413:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77859880 x1868815139945856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241194.249425:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139945856:0@lo:400:kworker.0 00010000:00080000:2.0:1782241194.249442:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77a54e00 x1868815139944320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241194.249461:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139944320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241194.249525:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139944448:0@lo:400:kworker.0 00000100:00100000:2.0:1782241194.249558:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139944576:0@lo:400:kworker.0 00000100:00100000:2.0:1782241194.249570:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139945088:0@lo:400:kworker.0 00000100:00100000:3.0:1782241194.249571:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782241194.249580:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139945600:0@lo:400:kworker.0 00010000:00080000:2.0:1782241194.249591:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47830380 x1868815139945216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241194.249600:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815139945216:0@lo:400:kworker.0 00010000:00080000:2.0:1782241194.249612:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7785ad80 x1868815139945728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241194.249618:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815139945728:0@lo:400:kworker.0 00010000:00010000:2.0:1782241194.628949:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241194.757224:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782241194.757247:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139946112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241194.757314:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241194.757406:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139946112 00000100:00100000:3.0:1782241194.757414:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139946112 00000100:00100000:3.0:1782241194.757474:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782241194.757483:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139946112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782241194.757516:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782241194.757572:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139946112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241194.757580:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782241194.757826:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139946112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241194.758900:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139946240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241194.758947:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241194.759053:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139946240 00000100:00100000:0.0:1782241194.759060:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139946240 00000100:00100000:0.0:1782241194.759111:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782241194.759120:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d995f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139946240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241194.759139:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241194.759212:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d995f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139946240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241194.759218:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1782241194.759256:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9b480 x1868815139946240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241194.759272:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139946240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241194.910686:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241194.910799:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241194.910838:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241194.910874:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119951744 00000100:00100000:1.0:1782241194.910924:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119951872 00000100:00100000:0.0:1782241194.910926:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119951744 00000100:00100000:1.0:1782241194.910929:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119951872 00000100:00100000:1.0:1782241194.910972:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119952000 00000100:00100000:1.0:1782241194.910974:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119952000 00000100:00100000:0.0:1782241194.910976:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 286 00000100:00100000:0.0:1782241194.910984:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2399:x1868815119951744:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241194.910993:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 109 00000100:00100000:0.0:1782241194.911055:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2399:x1868815119951744:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 71us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241194.911063:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 286 00000100:00080000:0.0:1782241194.911093:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241194.911098:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241194.911195:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2398:x1868815119951872:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241194.911243:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 110 00000100:00100000:2.0:1782241194.911252:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119952000:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241194.911301:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2398:x1868815119951872:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 108us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241194.911308:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 109 00000100:00100000:2.0:1782241194.911430:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119952000:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 179us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241194.911438:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 110 00010000:00010000:1.0:1782241195.652882:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241196.294373:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139946368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782241196.295273:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241196.295394:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241196.295405:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139946496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241196.295448:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241196.296338:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139946368 00000100:00100000:0.0:1782241196.296349:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139946368 00000100:00100000:0.0:1782241196.296415:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139946496 00000100:00100000:0.0:1782241196.296419:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139946496 00000100:00100000:0.0:1782241196.296441:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782241196.296450:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139946368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782241196.296615:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241196.296705:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139946368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 254us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241196.296713:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782241196.296736:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782241196.296743:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139946496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782241196.296774:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241196.296806:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139946496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241196.296830:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1782241196.296852:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782241196.296893:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a99180 x1868815139946496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241196.297546:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139946496:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1782241196.297572:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9b480 x1868815139946368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241196.297587:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139946368:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782241196.681625:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241197.702397:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241198.341842:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139946624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241198.342521:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241198.342727:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139946624 00000100:00100000:3.0:1782241198.342737:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139946624 00000100:00100000:3.0:1782241198.342831:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782241198.342843:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139946624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782241198.342893:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782241198.342974:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139946624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241198.342995:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782241198.343649:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139946624:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782241198.725943:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241199.365504:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241199.365534:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139946752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241199.365745:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241199.366464:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139946752 00000100:00100000:3.0:1782241199.366476:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139946752 00000100:00100000:3.0:1782241199.366551:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782241199.366565:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139946752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782241199.366619:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241199.366696:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139946752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241199.366704:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1782241199.366735:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782241199.366782:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139947008:0@lo:400:kworker.0 00000100:00100000:3.0:1782241199.366819:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241199.366846:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241199.366852:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139946880:0@lo:400:kworker.0 00000100:00100000:3.0:1782241199.366887:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241199.366934:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139947136:0@lo:400:kworker.0 00000100:00100000:3.0:1782241199.366963:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1782241199.367001:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7785b100 x1868815139946752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241199.367024:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139946752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241199.367307:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139946880 00000100:00100000:3.0:1782241199.367313:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139946880 00000100:00100000:3.0:1782241199.367371:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1782241199.367378:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139946880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241199.367484:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139946880:12345-0@lo:400:kworker.0 Request processed in 47us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241199.367494:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1782241199.367530:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139947008 00000100:00100000:3.0:1782241199.367533:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139947008 00000100:00100000:3.0:1782241199.367563:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782241199.367570:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139947008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241199.367841:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139947008:12345-0@lo:400:kworker.0 Request processed in 270us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241199.367850:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782241199.368046:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139946880:0@lo:400:kworker.0 00000100:00100000:3.0:1782241199.368060:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139947008:0@lo:400:kworker.0 00000100:00100000:3.0:1782241199.368233:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139947136 00000100:00100000:3.0:1782241199.368239:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139947136 00000100:00100000:3.0:1782241199.368275:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782241199.368283:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139947136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241199.368334:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139947136:12345-0@lo:400:kworker.0 Request processed in 52us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241199.368341:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782241199.368374:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139947136:0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.368525:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139947264:0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.368587:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241199.368649:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139947776:0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.368677:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241199.368700:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139948288:0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.368743:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241199.368791:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782241199.368798:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815139947648:0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.368822:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241199.368845:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815139948160:0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.368866:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241199.368895:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139947392:0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.368922:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241199.368941:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139947904:0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.368959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241199.368977:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782241199.368982:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815139947520:0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.369000:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241199.369016:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815139948032:0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.369035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241199.369062:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139947264 00000100:00100000:2.0:1782241199.369066:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139947264 00000100:00100000:2.0:1782241199.369091:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139947648 00000100:00100000:2.0:1782241199.369094:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139947648 00000100:00100000:2.0:1782241199.369117:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139948160 00000100:00100000:2.0:1782241199.369121:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139948160 00000100:00100000:2.0:1782241199.369132:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139947520 00000100:00100000:2.0:1782241199.369140:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139947520 00000100:00100000:2.0:1782241199.369156:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139948032 00000100:00100000:2.0:1782241199.369159:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139948032 00000100:00100000:2.0:1782241199.369175:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1782241199.369182:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139947264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.369231:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139947264:12345-0@lo:400:kworker.0 Request processed in 49us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241199.369238:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1782241199.369254:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782241199.369262:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815139947648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.369295:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815139947648:12345-0@lo:400:kworker.0 Request processed in 33us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241199.369301:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782241199.369312:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782241199.369318:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815139948160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.369348:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815139948160:12345-0@lo:400:kworker.0 Request processed in 31us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241199.369353:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782241199.369364:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1782241199.369370:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815139947520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.369401:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815139947520:12345-0@lo:400:kworker.0 Request processed in 31us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241199.369407:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1782241199.369417:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1782241199.369424:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815139948032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.369454:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815139948032:12345-0@lo:400:kworker.0 Request processed in 31us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241199.369467:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1782241199.369493:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139947776 00000100:00100000:2.0:1782241199.369498:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139947776 00000100:00100000:2.0:1782241199.369530:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139948288 00000100:00100000:2.0:1782241199.369536:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139948288 00000100:00100000:2.0:1782241199.369556:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139947904 00000100:00100000:2.0:1782241199.369559:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139947904 00000100:00100000:2.0:1782241199.369573:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782241199.369580:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139947776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.369630:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139947776:12345-0@lo:400:kworker.0 Request processed in 51us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241199.369636:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782241199.369647:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782241199.369653:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139948288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.369683:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139948288:12345-0@lo:400:kworker.0 Request processed in 31us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241199.369689:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782241199.369700:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782241199.369707:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139947904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.369739:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139947904:12345-0@lo:400:kworker.0 Request processed in 32us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241199.369744:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782241199.369813:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139947392 00000100:00100000:2.0:1782241199.369818:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139947392 00000100:00100000:2.0:1782241199.369846:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782241199.369853:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139947392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.369900:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139947392:12345-0@lo:400:kworker.0 Request processed in 48us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241199.369906:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1782241199.369936:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782241199.369940:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782241199.369944:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782241199.369946:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1782241199.369977:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77a57100 x1868815139947648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241199.369992:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815139947648:0@lo:400:kworker.0 00010000:00080000:2.0:1782241199.370005:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f609500 x1868815139948160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241199.370013:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815139948160:0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.370024:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139947264:0@lo:400:kworker.0 00010000:00080000:2.0:1782241199.370034:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47850e00 x1868815139947776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241199.370042:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139947776:0@lo:400:kworker.0 00010000:00080000:2.0:1782241199.370052:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f60b100 x1868815139948288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241199.370059:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139948288:0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.370104:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815139947520:0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.370116:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815139948032:0@lo:400:kworker.0 00000100:00100000:2.0:1782241199.370127:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139947392:0@lo:400:kworker.0 00010000:00080000:2.0:1782241199.370148:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f609f80 x1868815139947904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241199.370157:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139947904:0@lo:400:kworker.0 00010000:00010000:2.0:1782241199.748942:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241199.878166:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139948416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241199.878266:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241199.878333:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241199.878340:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139948544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241199.878368:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241199.878417:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139948416 00000100:00100000:1.0:1782241199.878438:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139948416 00000100:00100000:1.0:1782241199.878497:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782241199.878506:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139948416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782241199.878535:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241199.878583:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139948416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241199.878591:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782241199.878631:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139948544 00000100:00100000:1.0:1782241199.878636:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139948544 00000100:00100000:1.0:1782241199.878664:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782241199.878671:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139948544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241199.878703:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241199.878732:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139948544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241199.878738:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782241199.878807:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139948544:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1782241199.878823:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d994a80 x1868815139948416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241199.880746:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139948416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241200.039173:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241200.039221:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241200.039263:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241200.039350:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119952128 00000100:00100000:2.0:1782241200.039362:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119952128 00000100:00100000:2.0:1782241200.039434:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 288 00000100:00100000:2.0:1782241200.039447:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2398:x1868815119952128:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241200.039543:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2398:x1868815119952128:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 100us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241200.039552:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 288 00000100:00100000:2.0:1782241200.039605:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119952256 00000100:00100000:2.0:1782241200.039610:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119952256 00000100:00100000:2.0:1782241200.039650:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119952384 00000100:00100000:2.0:1782241200.039653:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119952384 00000100:00100000:2.0:1782241200.039674:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 117 00000100:00100000:2.0:1782241200.039681:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119952256:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241200.039715:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119952256:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 35us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241200.039722:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 117 00000100:00100000:2.0:1782241200.039734:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 118 00000100:00100000:2.0:1782241200.039740:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119952384:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241200.041938:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119952384:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 2181us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241200.041957:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 118 00000100:00080000:2.0:1782241200.042473:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241200.042480:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782241200.773438:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241201.413252:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782241201.413281:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139948672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241201.413367:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241201.413451:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139948672 00000100:00100000:1.0:1782241201.413459:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139948672 00000100:00100000:1.0:1782241201.413519:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782241201.413529:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139948672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782241201.413565:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241201.413620:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139948672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241201.413628:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1782241201.413651:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782241201.413682:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d996680 x1868815139948672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241201.413702:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139948672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241201.413870:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241201.413881:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139948800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241201.413912:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241201.414122:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139948800 00000100:00100000:0.0:1782241201.414127:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139948800 00000100:00100000:0.0:1782241201.414168:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782241201.414174:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139948800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782241201.414187:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241201.414252:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139948800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241201.414258:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1782241201.414285:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a99180 x1868815139948800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241201.414298:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139948800:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782241201.414341:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782241201.797099:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782241201.956144:0:11988:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 15:00:01 (1782241201) === 00000100:00100000:2.0:1782241202.358313:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241202.358486:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119952512 00000100:00100000:0.0:1782241202.358502:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119952512 00000100:00100000:0.0:1782241202.358590:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 289 00000100:00100000:0.0:1782241202.358605:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:8723:x1868815119952512:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782241202.358632:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241202.358658:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e778f0c00/0xc9959f2fb1e197c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d333505031 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241202.358699:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e778f0c00/0xc9959f2fb1e197c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505031 expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241202.358715:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e778f0c00/0xc9959f2fb1e197c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505031 expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241202.358726:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0c00, rc 0) 00000100:00100000:0.0:1782241202.358851:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:8723:x1868815119952512:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 250us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241202.358860:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 289 00000100:00100000:3.0:1782241202.362303:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241202.362559:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119952640 00000100:00100000:1.0:1782241202.362575:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119952640 00000100:00100000:1.0:1782241202.362650:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 290 00000100:00100000:1.0:1782241202.362663:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:8723:x1868815119952640:12345-192.168.204.58@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782241202.362916:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:8723:x1868815119952640:12345-192.168.204.58@tcp:501:mount.lustre.0 Request processed in 254us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241202.362939:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 290 00000100:00100000:0.0:1782241202.371173:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241202.371423:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119952768 00000100:00100000:2.0:1782241202.371437:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119952768 00000100:00100000:2.0:1782241202.371513:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 291 00000100:00100000:2.0:1782241202.371525:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e49385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:8723:x1868815119952768:12345-192.168.204.58@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782241202.371737:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e49385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:8723:x1868815119952768:12345-192.168.204.58@tcp:503:mount.lustre.0 Request processed in 213us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241202.371747:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 291 00000100:00100000:3.0:1782241202.387907:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241202.388043:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119952896 00000100:00100000:0.0:1782241202.388057:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119952896 00000100:00100000:0.0:1782241202.388513:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 292 00000100:00100000:0.0:1782241202.388527:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e438c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:8727:x1868815119952896:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782241202.388829:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e438c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:8727:x1868815119952896:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 305us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241202.388839:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 292 00000100:00100000:3.0:1782241202.421633:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241202.421840:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119953024 00000100:00100000:1.0:1782241202.421854:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119953024 00000100:00100000:1.0:1782241202.421941:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 293 00000100:00100000:1.0:1782241202.421954:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e438c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:8727:x1868815119953024:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782241202.422177:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e438c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:8727:x1868815119953024:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 225us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241202.422186:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 293 00000100:00100000:1.0:1782241202.425858:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241202.426860:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119953152 00000100:00100000:2.0:1782241202.426875:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119953152 00000100:00100000:2.0:1782241202.426962:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 294 00000100:00100000:2.0:1782241202.426974:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e438c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:8727:x1868815119953152:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782241202.427189:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e438c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:8727:x1868815119953152:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 215us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241202.427197:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 294 00000100:00100000:3.0:1782241202.435014:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241202.435198:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119953280 00000100:00100000:0.0:1782241202.435229:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119953280 00000100:00100000:0.0:1782241202.435309:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 295 00000100:00100000:0.0:1782241202.435322:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:8723:x1868815119953280:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782241202.435346:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241202.435382:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e778f0a00/0xc9959f2fb1e197cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d333505062 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241202.435423:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e778f0a00/0xc9959f2fb1e197cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505062 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241202.435437:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e778f0a00/0xc9959f2fb1e197cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505062 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241202.435448:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0a00, rc 0) 00000100:00100000:0.0:1782241202.435529:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:8723:x1868815119953280:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 209us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241202.435537:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 295 00000100:00100000:3.0:1782241202.446280:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241202.446385:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119953408 00000100:00100000:1.0:1782241202.446400:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119953408 00000100:00100000:1.0:1782241202.446476:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 296 00000100:00100000:1.0:1782241202.446489:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:8723:x1868815119953408:12345-192.168.204.58@tcp:256:mount.lustre.0 20000000:01000000:1.0:1782241202.446526:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782241202.446570:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782241202.446575:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782241202.446579:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782241202.446583:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1782241202.446585:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1782241202.450948:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:8723:x1868815119953408:12345-192.168.204.58@tcp:256:mount.lustre.0 Request processed in 4444us (4667us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241202.450968:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 296 00000100:00100000:3.0:1782241202.455246:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241202.457275:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119953536 00000100:00100000:2.0:1782241202.457294:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119953536 00000100:00100000:2.0:1782241202.457522:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 297 00000100:00100000:2.0:1782241202.457536:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:8723:x1868815119953536:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782241202.457572:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241202.457598:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e197d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d333505069 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241202.457646:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e197d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505069 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241202.457679:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e197d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505069 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241202.457690:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860000, rc 0) 00000100:00100000:2.0:1782241202.457933:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:8723:x1868815119953536:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 399us (2702us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241202.457941:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 297 00000100:00100000:0.0:1782241202.461960:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241202.462136:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119953664 00000100:00100000:3.0:1782241202.462151:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119953664 00000100:00100000:3.0:1782241202.462266:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 298 00000100:00100000:3.0:1782241202.462279:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:8723:x1868815119953664:12345-192.168.204.58@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782241202.462500:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:8723:x1868815119953664:12345-192.168.204.58@tcp:501:mount.lustre.0 Request processed in 222us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241202.462509:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 298 00000100:00100000:1.0:1782241202.466132:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241202.466557:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119953792 00000100:00100000:2.0:1782241202.466571:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119953792 00000100:00100000:2.0:1782241202.466655:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 299 00000100:00100000:2.0:1782241202.466667:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:8723:x1868815119953792:12345-192.168.204.58@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782241202.467482:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:8723:x1868815119953792:12345-192.168.204.58@tcp:503:mount.lustre.0 Request processed in 812us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241202.467493:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 299 00000100:00100000:2.0:1782241202.474587:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241202.475410:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119953920 00000100:00100000:3.0:1782241202.475423:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119953920 00000100:00100000:3.0:1782241202.475542:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 300 00000100:00100000:3.0:1782241202.475564:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:8732:x1868815119953920:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782241202.475871:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:8732:x1868815119953920:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 309us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241202.475880:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 300 00000100:00100000:2.0:1782241202.480572:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241202.481691:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119954048 00000100:00100000:0.0:1782241202.481706:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119954048 00000100:00100000:0.0:1782241202.481795:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 301 00000100:00100000:0.0:1782241202.481806:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:8732:x1868815119954048:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782241202.482021:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:8732:x1868815119954048:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 215us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241202.482132:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 301 00000100:00100000:1.0:1782241202.487710:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241202.487805:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119954176 00000100:00100000:1.0:1782241202.487813:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241202.487819:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119954176 00000100:00100000:1.0:1782241202.487853:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241202.487887:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119954432 00000100:00100000:2.0:1782241202.487891:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119954432 00000100:00100000:2.0:1782241202.487905:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119954560 00000100:00100000:2.0:1782241202.487908:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119954560 00000100:00100000:1.0:1782241202.487940:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241202.487949:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119954688 00000100:00100000:2.0:1782241202.487953:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119954688 00000100:00100000:2.0:1782241202.487975:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 119 00000100:00100000:2.0:1782241202.487988:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2396:x1868815119954560:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241202.488003:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 16 00000100:00100000:1.0:1782241202.488013:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1868815119954176:12345-192.168.204.58@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782241202.488045:0:6512:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 863fc9a5-c349-42ab-bac8-b8fe4972688d@192.168.204.58@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:1.0:1782241202.488093:0:6512:0:(genops.c:1406:class_connect()) connect: client 863fc9a5-c349-42ab-bac8-b8fe4972688d, cookie 0xc9959f2fb1e197db 00000100:00100000:2.0:1782241202.488106:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2396:x1868815119954560:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 119us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241202.488116:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 119 00000004:00100000:1.0:1782241202.488130:0:6512:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1782241202.488136:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 120 00000100:00100000:2.0:1782241202.488143:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119954688:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241202.488166:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119954688:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 25us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241202.488172:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 120 00000100:00100000:2.0:1782241202.488182:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:2.0:1782241202.488186:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1868815119954432:12345-192.168.204.58@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782241202.488201:0:10147:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 863fc9a5-c349-42ab-bac8-b8fe4972688d@192.168.204.58@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:2.0:1782241202.488224:0:10147:0:(genops.c:1406:class_connect()) connect: client 863fc9a5-c349-42ab-bac8-b8fe4972688d, cookie 0xc9959f2fb1e197e2 00000004:00100000:2.0:1782241202.488241:0:10147:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782241202.488386:0:10147:0:(import.c:65:import_set_state_nolock()) ffff890d47b7b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241202.488420:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2395:x1868815119954432:12345-192.168.204.58@tcp:38:mount.lustre.0 Request processed in 232us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241202.488427:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00080000:1.0:1782241202.488540:0:6512:0:(import.c:65:import_set_state_nolock()) ffff890d47859000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241202.488583:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2395:x1868815119954176:12345-192.168.204.58@tcp:38:mount.lustre.0 Request processed in 568us (888us total) trans 0 rc 0/0 00000100:00080000:3.0:1782241202.488589:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782241202.488594:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 16 00000100:00080000:3.0:1782241202.488597:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241202.495223:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241202.495286:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241202.495329:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241202.495708:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119954816 00000100:00100000:0.0:1782241202.495729:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119954816 00000100:00100000:0.0:1782241202.496010:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119954304 00000100:00100000:0.0:1782241202.496015:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119954304 00000100:00080000:2.0:1782241202.496074:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782241202.496090:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782241202.496257:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119954944 00000100:00100000:3.0:1782241202.496262:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119954944 00000100:00100000:3.0:1782241202.496322:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:3.0:1782241202.496337:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:0:x1868815119954816:12345-192.168.204.58@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782241202.496388:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782241202.496498:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:0:x1868815119954816:12345-192.168.204.58@tcp:41:mount.lustre.0 Request processed in 165us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241202.496506:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:3.0:1782241202.496529:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:3.0:1782241202.496535:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+7:0:x1868815119954304:12345-192.168.204.58@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782241202.496567:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782241202.496607:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+7:0:x1868815119954304:12345-192.168.204.58@tcp:41:mount.lustre.0 Request processed in 72us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241202.496614:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:2.0:1782241202.497098:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:2.0:1782241202.497106:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:8723:x1868815119954944:12345-192.168.204.58@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782241202.497135:0:10147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782241202.497174:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:8723:x1868815119954944:12345-192.168.204.58@tcp:41:mount.lustre.0 Request processed in 69us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241202.497181:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:2.0:1782241202.506057:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241202.509029:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119955072 00000100:00100000:3.0:1782241202.509051:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119955072 00000100:00100000:2.0:1782241202.510103:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:2.0:1782241202.510118:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:8723:x1868815119955072:12345-192.168.204.58@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782241202.510259:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:8723:x1868815119955072:12345-192.168.204.58@tcp:40:mount.lustre.0 Request processed in 143us (4216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241202.510268:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:2.0:1782241202.517696:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241202.525619:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241202.525718:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119955200 00000100:00100000:2.0:1782241202.525818:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241202.525930:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119955328 00000100:00100000:3.0:1782241202.525940:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119955328 00000100:00100000:3.0:1782241202.525999:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:3.0:1782241202.526010:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1868815119955328:12345-192.168.204.58@tcp:8:mount.lustre.0 00000100:00100000:1.0:1782241202.526033:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119955200 00010000:00080000:3.0:1782241202.526058:0:8426:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 863fc9a5-c349-42ab-bac8-b8fe4972688d@192.168.204.58@tcp t0 exp 0000000000000000 cur 265 last 0 00000100:00100000:1.0:1782241202.526088:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:1.0:1782241202.526096:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1868815119955200:12345-192.168.204.58@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782241202.526116:0:8423:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 863fc9a5-c349-42ab-bac8-b8fe4972688d@192.168.204.58@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:1.0:1782241202.526145:0:8423:0:(genops.c:1406:class_connect()) connect: client 863fc9a5-c349-42ab-bac8-b8fe4972688d, cookie 0xc9959f2fb1e197f0 00002000:00100000:1.0:1782241202.526287:0:8423:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 863fc9a5-c349-42ab-bac8-b8fe4972688d/ffff890d4785f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:3.0:1782241202.526297:0:8426:0:(genops.c:1406:class_connect()) connect: client 863fc9a5-c349-42ab-bac8-b8fe4972688d, cookie 0xc9959f2fb1e197e9 00002000:00100000:1.0:1782241202.526304:0:8423:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:3.0:1782241202.526306:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 863fc9a5-c349-42ab-bac8-b8fe4972688d/ffff890d47596800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782241202.526326:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782241202.526418:0:8423:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:3.0:1782241202.526419:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782241202.526464:0:8426:0:(import.c:65:import_set_state_nolock()) ffff890d47593800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1782241202.526464:0:8423:0:(import.c:65:import_set_state_nolock()) ffff890d4785a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782241202.526575:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2395:x1868815119955328:12345-192.168.204.58@tcp:8:mount.lustre.0 Request processed in 564us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241202.526586:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:0.0:1782241202.526743:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119955456 00000100:00100000:0.0:1782241202.526749:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119955456 00000100:00100000:0.0:1782241202.526826:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:0.0:1782241202.526835:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:8723:x1868815119955456:12345-192.168.204.58@tcp:900:mount.lustre.0 00000100:00100000:1.0:1782241202.528990:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2395:x1868815119955200:12345-192.168.204.58@tcp:8:mount.lustre.0 Request processed in 2869us (3363us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241202.529012:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:0.0:1782241202.529025:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:8723:x1868815119955456:12345-192.168.204.58@tcp:900:mount.lustre.0 Request processed in 2188us (11340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241202.529038:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:2.0:1782241202.550542:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241202.551703:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119955584 00000100:00100000:0.0:1782241202.551721:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119955584 00000100:00100000:0.0:1782241202.551843:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 1 00000100:00100000:0.0:1782241202.551856:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:8723:x1868815119955584:12345-192.168.204.58@tcp:33:mount.lustre.0 00000004:00200000:0.0:1782241202.551984:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1782241202.552115:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:8723:x1868815119955584:12345-192.168.204.58@tcp:33:mount.lustre.0 Request processed in 261us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241202.552124:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 1 00010000:00010000:3.0:1782241202.826966:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241203.465410:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139948928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241203.465509:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241203.465671:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139948928 00000100:00100000:0.0:1782241203.465681:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139948928 00000100:00100000:0.0:1782241203.465784:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782241203.465796:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139948928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241203.465841:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782241203.465945:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139948928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241203.466074:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782241203.466182:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139948928:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782241203.845238:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241204.485258:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139949056:0@lo:400:kworker.0 00000100:00100000:2.0:1782241204.485383:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241204.485483:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139949184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241204.485526:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241204.485618:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139949056 00000100:00100000:3.0:1782241204.485629:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139949056 00000100:00100000:0.0:1782241204.485667:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139949184 00000100:00100000:0.0:1782241204.485689:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139949184 00000100:00100000:3.0:1782241204.485696:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1782241204.485707:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139949056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241204.485732:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782241204.485739:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139949184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782241204.486553:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241204.491579:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139949056:12345-0@lo:400:kworker.0 Request processed in 5860us (6183us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241204.491598:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1782241204.491688:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139949568:0@lo:400:kworker.0 00000100:00080000:3.0:1782241204.491723:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782241204.491749:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139949440:0@lo:400:kworker.0 00000100:00100000:1.0:1782241204.491786:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241204.491799:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241204.491826:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815139949952:0@lo:400:kworker.0 00000100:00100000:1.0:1782241204.491826:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139950080:0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.491846:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241204.491847:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241204.491863:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815139950464:0@lo:400:kworker.0 00000100:00100000:1.0:1782241204.491863:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139950592:0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.491882:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241204.491882:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241204.491908:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1782241204.491908:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782241204.491914:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139949312:0@lo:400:kworker.0 00000100:00100000:1.0:1782241204.491914:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139949696:0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.491934:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241204.491934:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241204.491951:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139949824:0@lo:400:kworker.0 00000100:00100000:1.0:1782241204.491951:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139950208:0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.491972:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241204.491986:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139950336:0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.492007:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241204.492048:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139949440 00000100:00100000:3.0:1782241204.492057:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139949440 00000100:00100000:3.0:1782241204.492103:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139949696 00000100:00100000:3.0:1782241204.492106:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139949696 00000100:00100000:3.0:1782241204.492124:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782241204.492134:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139949440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241204.492144:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241204.492186:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139949568 00000100:00100000:1.0:1782241204.492190:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139949568 00000100:00100000:3.0:1782241204.492203:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139949440:12345-0@lo:400:kworker.0 Request processed in 71us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241204.492209:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782241204.492213:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139949952 00000100:00100000:1.0:1782241204.492216:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139949952 00000100:00100000:3.0:1782241204.492223:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782241204.492229:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139949696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241204.492236:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139950464 00000100:00100000:1.0:1782241204.492239:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139950464 00000100:00100000:1.0:1782241204.492251:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139949312 00000100:00100000:1.0:1782241204.492254:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139949312 00000100:00100000:3.0:1782241204.492259:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139949696:12345-0@lo:400:kworker.0 Request processed in 31us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241204.492265:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782241204.492265:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139949824 00000100:00100000:1.0:1782241204.492267:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139949824 00000100:00100000:1.0:1782241204.492278:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139950336 00000100:00100000:1.0:1782241204.492280:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139950336 00000100:00100000:3.0:1782241204.492285:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1782241204.492291:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139949568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241204.492293:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1782241204.492298:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815139949952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.492319:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139949568:12345-0@lo:400:kworker.0 Request processed in 28us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241204.492323:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815139949952:12345-0@lo:400:kworker.0 Request processed in 25us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241204.492326:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1782241204.492328:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1782241204.492875:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139949056:0@lo:400:kworker.0 00000100:00100000:0.0:1782241204.493075:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139949184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7333us (7546us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241204.493085:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782241204.493721:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139950080 00000100:00100000:0.0:1782241204.493731:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139950080 00000100:00100000:3.0:1782241204.495304:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1782241204.495335:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815139950464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.495477:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815139950464:12345-0@lo:400:kworker.0 Request processed in 158us (3593us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241204.495486:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1782241204.495535:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1782241204.495544:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139949312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.495599:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139949312:12345-0@lo:400:kworker.0 Request processed in 58us (3664us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241204.495606:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1782241204.495619:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1782241204.495627:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139949824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.495655:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139949824:12345-0@lo:400:kworker.0 Request processed in 29us (3682us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241204.495662:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1782241204.495673:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1782241204.495679:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139950336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.495706:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139950336:12345-0@lo:400:kworker.0 Request processed in 27us (3698us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241204.495712:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1782241204.495780:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139950592 00000100:00100000:3.0:1782241204.495787:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139950592 00000100:00100000:3.0:1782241204.495854:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139950208 00000100:00100000:3.0:1782241204.495858:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139950208 00000100:00100000:3.0:1782241204.495890:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782241204.495897:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139950592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.495932:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139950592:12345-0@lo:400:kworker.0 Request processed in 35us (4049us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241204.495939:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782241204.495955:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782241204.495961:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139950208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.495989:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139950208:12345-0@lo:400:kworker.0 Request processed in 28us (3844us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241204.496005:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1782241204.496045:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782241204.496050:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782241204.496053:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782241204.496057:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782241204.496102:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139949312:0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.496116:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139949824:0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.496127:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139950336:0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.496141:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139949440:0@lo:400:kworker.0 00010000:00080000:3.0:1782241204.496615:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d99a680 x1868815139949952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241204.496631:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815139949952:0@lo:400:kworker.0 00010000:00080000:3.0:1782241204.496651:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d998000 x1868815139950464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241204.496660:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815139950464:0@lo:400:kworker.0 00000100:00100000:0.0:1782241204.496889:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782241204.496903:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139950080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.496915:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139949696:0@lo:400:kworker.0 00010000:00080000:3.0:1782241204.496929:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d99bb80 x1868815139950208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241204.496939:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139950208:0@lo:400:kworker.0 00000100:00100000:3.0:1782241204.496952:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139949568:0@lo:400:kworker.0 00010000:00080000:3.0:1782241204.496962:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d999500 x1868815139950080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241204.496980:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139950080:0@lo:400:kworker.0 00010000:00080000:3.0:1782241204.496998:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d999880 x1868815139950592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241204.497006:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139950592:0@lo:400:kworker.0 00000100:00100000:0.0:1782241204.497015:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139950080:12345-0@lo:400:kworker.0 Request processed in 118us (5166us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241204.497021:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1782241204.498563:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77858a80 x1868815139949184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241204.498596:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139949184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782241204.870181:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241204.998040:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139950720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241204.998172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241204.998189:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241204.998231:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139950848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241204.998332:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139950720 00000100:00100000:0.0:1782241204.998343:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139950720 00000100:00100000:0.0:1782241204.998427:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782241204.998438:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139950720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241204.998475:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241204.999267:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241204.999310:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139950848 00000100:00100000:1.0:1782241204.999318:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139950848 00000100:00100000:1.0:1782241204.999374:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782241204.999384:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139950848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241204.999423:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241204.999480:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139950848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241204.999488:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782241204.999571:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139950848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241204.999816:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139950720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1378us (1644us total) trans 0 rc 0/0 00010000:00080000:1.0:1782241204.999823:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77b45500 x1868815139950720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241204.999830:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782241204.999867:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139950720:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1782241205.893099:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241206.532969:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241206.533010:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139950976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782241206.533085:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241206.533119:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139950976 00000100:00100000:3.0:1782241206.533128:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139950976 00000100:00080000:0.0:1782241206.533214:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241206.533258:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782241206.533268:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139950976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782241206.533297:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241206.533355:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139950976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (270us total) trans 0 rc 0/0 00010000:00080000:2.0:1782241206.533414:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9a680 x1868815139950976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241206.533434:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139950976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241206.535776:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782241206.538026:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139951104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782241206.538104:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241206.538330:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139951104 00000100:00100000:0.0:1782241206.538338:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139951104 00000100:00100000:0.0:1782241206.538398:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782241206.538407:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139951104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782241206.538433:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241206.538522:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139951104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241206.538528:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1782241206.538549:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782241206.539386:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47874e00 x1868815139951104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241206.539410:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139951104:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1782241206.918644:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241207.706957:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241207.707017:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241207.707051:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241207.707079:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241207.707104:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241207.707125:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241207.707149:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241207.707176:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119955968 00000100:00100000:2.0:1782241207.707184:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119955968 00000100:00100000:1.0:1782241207.707224:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119956224 00000100:00100000:1.0:1782241207.707230:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119956224 00000100:00100000:2.0:1782241207.707245:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119955840 00000100:00100000:2.0:1782241207.707250:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119955840 00000100:00100000:1.0:1782241207.707261:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119956096 00000100:00100000:2.0:1782241207.707277:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 127 00000100:00100000:1.0:1782241207.707277:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119956096 00000100:00100000:2.0:1782241207.707293:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119955968:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241207.707306:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 128 00000100:00100000:1.0:1782241207.707317:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2396:x1868815119956224:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241207.707401:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119955712 00000100:00100000:3.0:1782241207.707406:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119955712 00000100:00100000:3.0:1782241207.707456:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 303 00000100:00100000:3.0:1782241207.707464:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815119955712:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241207.707507:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119955968:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 87us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241207.707526:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 127 00000100:00100000:2.0:1782241207.707545:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 129 00000100:00100000:2.0:1782241207.707553:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f60b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2396:x1868815119955840:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241207.709509:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2396:x1868815119956224:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 2182us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241207.709523:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 128 00000100:00100000:1.0:1782241207.709685:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 130 00000100:00100000:1.0:1782241207.709697:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f60b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2396:x1868815119956096:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241207.709778:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f60b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2396:x1868815119956096:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 86us (2652us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241207.709784:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 130 00000100:00100000:3.0:1782241207.711556:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815119955712:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 4081us (4605us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241207.711572:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 303 00000100:00100000:2.0:1782241207.711750:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f60b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2396:x1868815119955840:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 4194us (4641us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241207.711773:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 129 00000100:00100000:2.0:1782241207.711811:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119956480 00000100:00100000:2.0:1782241207.711820:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119956480 00000100:00100000:2.0:1782241207.711871:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119956352 00000100:00100000:2.0:1782241207.711875:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119956352 00000100:00100000:2.0:1782241207.711901:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 52 00000100:00100000:2.0:1782241207.711910:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2396:x1868815119956480:12345-192.168.204.58@tcp:400:kworker.0 00000100:00080000:3.0:1782241207.712335:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782241207.712341:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782241207.712344:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782241207.712418:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782241207.712436:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 53 00000100:00100000:3.0:1782241207.712467:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2396:x1868815119956352:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241207.712564:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2396:x1868815119956480:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 655us (5483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241207.712571:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 52 00000100:00100000:3.0:1782241207.713470:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2396:x1868815119956352:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 1002us (6315us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241207.713481:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 53 00010000:00010000:0.0:1782241207.941590:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782241208.135175:0:12181:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1782241208.584174:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241208.584199:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139951232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241208.584278:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241208.584423:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139951232 00000100:00100000:1.0:1782241208.584449:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139951232 00000100:00100000:1.0:1782241208.584516:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782241208.584531:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139951232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782241208.584582:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1782241208.584699:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139951232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 170us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241208.584708:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1782241208.585596:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139951232:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1782241208.587596:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 863fc9a5-c349-42ab-bac8-b8fe4972688d 00000001:00100000:1.0:1782241208.587746:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 863fc9a5-c349-42ab-bac8-b8fe4972688d 00000001:00100000:0.0:1782241208.588467:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 863fc9a5-c349-42ab-bac8-b8fe4972688d 00000001:00100000:2.0:1782241208.588554:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 863fc9a5-c349-42ab-bac8-b8fe4972688d 00010000:00010000:0.0:1782241208.969833:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241209.605285:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782241209.605322:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139951360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241209.605427:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241209.605788:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139951360 00000100:00100000:0.0:1782241209.605800:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139951360 00000100:00100000:0.0:1782241209.605900:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782241209.605917:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139951360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782241209.605968:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241209.606084:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815139951872:0@lo:400:kworker.0 00000100:00100000:0.0:1782241209.606088:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139951360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241209.606098:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782241209.606131:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241209.606157:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139952384:0@lo:400:kworker.0 00000100:00100000:1.0:1782241209.606184:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241209.606213:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139952896:0@lo:400:kworker.0 00000100:00100000:1.0:1782241209.606236:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241209.606443:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139952384 00000100:00100000:0.0:1782241209.606449:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139952384 00000100:00100000:0.0:1782241209.606493:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139952896 00000100:00100000:0.0:1782241209.606497:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139952896 00000100:00080000:3.0:1782241209.606502:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782241209.606509:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782241209.606523:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815139951616:0@lo:400:kworker.0 00000100:00100000:0.0:1782241209.606530:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782241209.606540:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139952384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241209.606569:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241209.606598:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815139952128:0@lo:400:kworker.0 00000100:00100000:0.0:1782241209.606610:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139952384:12345-0@lo:400:kworker.0 Request processed in 70us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241209.606620:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782241209.606636:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782241209.606643:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139952896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241209.606691:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139952896:12345-0@lo:400:kworker.0 Request processed in 48us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241209.606697:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782241209.606861:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139951872 00000100:00100000:0.0:1782241209.606867:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139951872 00000100:00100000:0.0:1782241209.606897:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139951616 00000100:00100000:0.0:1782241209.606900:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139951616 00000100:00100000:0.0:1782241209.606922:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1782241209.606928:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815139951872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241209.606976:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815139951872:12345-0@lo:400:kworker.0 Request processed in 47us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241209.606983:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1782241209.607012:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1782241209.607020:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815139951616:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1782241209.607030:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77b47800 x1868815139952896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241209.607049:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139952896:0@lo:400:kworker.0 00000100:00100000:0.0:1782241209.607059:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815139951616:12345-0@lo:400:kworker.0 Request processed in 38us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241209.607066:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1782241209.607087:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139951744:0@lo:400:kworker.0 00000100:00100000:1.0:1782241209.607090:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815139951872:0@lo:400:kworker.0 00010000:00080000:1.0:1782241209.607106:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77b46300 x1868815139952384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241209.607117:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139952384:0@lo:400:kworker.0 00000100:00100000:1.0:1782241209.607131:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782241209.607138:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139951488:0@lo:400:kworker.0 00000100:00100000:1.0:1782241209.607178:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241209.607215:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139952000:0@lo:400:kworker.0 00000100:00100000:1.0:1782241209.607242:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241209.607268:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139952512:0@lo:400:kworker.0 00000100:00100000:0.0:1782241209.607291:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241209.607356:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241209.607434:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241209.607467:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139952512 00000100:00100000:1.0:1782241209.607471:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139952512 00000100:00100000:1.0:1782241209.607509:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782241209.607515:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139952512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241209.607564:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139952512:12345-0@lo:400:kworker.0 Request processed in 49us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241209.607571:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782241209.607593:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139952128 00000100:00100000:1.0:1782241209.607597:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139952128 00000100:00100000:1.0:1782241209.607622:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782241209.607629:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815139952128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241209.607674:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815139952128:12345-0@lo:400:kworker.0 Request processed in 45us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241209.607681:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782241209.607704:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139951488 00000100:00100000:1.0:1782241209.607707:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139951488 00000100:00100000:1.0:1782241209.607737:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1782241209.607745:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815139951488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241209.607810:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815139951488:12345-0@lo:400:kworker.0 Request processed in 66us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241209.607817:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1782241209.607861:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139952000 00000100:00100000:1.0:1782241209.607865:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139952000 00000100:00100000:1.0:1782241209.607902:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139951744 00000100:00100000:1.0:1782241209.607904:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139951744 00000100:00100000:1.0:1782241209.607918:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782241209.607936:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139952000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241209.607947:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815139952256:0@lo:400:kworker.0 00000100:00100000:1.0:1782241209.607976:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139952000:12345-0@lo:400:kworker.0 Request processed in 39us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241209.607984:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782241209.607998:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782241209.608013:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aa9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139951744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241209.608052:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aa9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139951744:12345-0@lo:400:kworker.0 Request processed in 40us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241209.608059:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:2.0:1782241209.608111:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d476eca80 x1868815139951360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241209.608135:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139951360:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782241209.608434:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782241209.608442:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241209.608485:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139951488:0@lo:400:kworker.0 00000100:00100000:1.0:1782241209.608498:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139952000:0@lo:400:kworker.0 00010000:00080000:1.0:1782241209.608511:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77b44380 x1868815139952512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241209.608521:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139952512:0@lo:400:kworker.0 00000100:00100000:3.0:1782241209.609310:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815139952128:0@lo:400:kworker.0 00000100:00100000:3.0:1782241209.609322:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815139952640:0@lo:400:kworker.0 00000100:00100000:3.0:1782241209.609369:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241209.609666:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815139951616:0@lo:400:kworker.0 00000100:00100000:1.0:1782241209.609810:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241209.614182:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139952640 00000100:00100000:2.0:1782241209.614206:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139952640 00000100:00100000:1.0:1782241209.614401:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815139952768:0@lo:400:kworker.0 00000100:00100000:1.0:1782241209.614495:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241209.614573:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139951744:0@lo:400:kworker.0 00000100:00100000:2.0:1782241209.614745:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139952256 00000100:00100000:2.0:1782241209.614750:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139952256 00000100:00100000:2.0:1782241209.614902:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139952768 00000100:00100000:2.0:1782241209.614914:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139952768 00000100:00100000:2.0:1782241209.614942:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782241209.614953:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815139952640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241209.615045:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815139952640:12345-0@lo:400:kworker.0 Request processed in 93us (5673us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241209.615053:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782241209.615075:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782241209.615083:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815139952256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241209.615119:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815139952256:12345-0@lo:400:kworker.0 Request processed in 36us (5310us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241209.615126:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782241209.615139:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1782241209.615146:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815139952768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241209.615176:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815139952768:12345-0@lo:400:kworker.0 Request processed in 31us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241209.615183:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1782241209.615217:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241209.615223:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241209.615257:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815139952640:0@lo:400:kworker.0 00010000:00080000:1.0:1782241209.615886:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77b44e00 x1868815139952256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241209.615899:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815139952256:0@lo:400:kworker.0 00010000:00080000:1.0:1782241209.615910:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77b47480 x1868815139952768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241209.615917:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815139952768:0@lo:400:kworker.0 00010000:00010000:0.0:1782241209.989064:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241210.117425:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241210.117450:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139953024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241210.117497:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782241210.117508:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139953152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241210.117537:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241210.117543:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241210.117599:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139953024 00000100:00100000:0.0:1782241210.117606:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139953024 00000100:00100000:0.0:1782241210.117693:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782241210.117704:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139953024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241210.117743:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241210.117844:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139953152 00000100:00100000:1.0:1782241210.117848:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139953152 00000100:00100000:1.0:1782241210.117877:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782241210.117884:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139953152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782241210.117899:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241210.117948:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139953152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241210.117955:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1782241210.118009:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a99180 x1868815139953152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241210.118027:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139953152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241210.122037:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139953024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4324us (4489us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241210.122059:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782241210.123233:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139953024:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782241211.013983:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241211.657808:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f60ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139953280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241211.657889:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241211.658084:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139953280 00000100:00100000:2.0:1782241211.658092:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139953280 00000100:00100000:2.0:1782241211.658266:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782241211.658278:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139953280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782241211.658310:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241211.658362:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139953280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241211.658396:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1782241211.658439:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f60ad80 x1868815139953280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241211.658456:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f60ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139953280:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1782241211.658873:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241211.659945:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139953408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241211.659997:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241211.660269:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139953408 00000100:00100000:2.0:1782241211.660276:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139953408 00000100:00100000:2.0:1782241211.660336:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782241211.660345:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139953408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782241211.660365:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1782241211.660843:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241211.662504:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139953408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2152us (2498us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241211.662518:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1782241211.662988:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a98380 x1868815139953408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241211.663013:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139953408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782241212.038520:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241212.829830:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241212.829886:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119956864 00000100:00100000:1.0:1782241212.829887:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241212.829901:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119956864 00000100:00100000:1.0:1782241212.830132:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241212.830171:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241212.836493:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241212.837512:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119957120 00000100:00100000:2.0:1782241212.837519:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119956736 00000100:00100000:3.0:1782241212.837529:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119957120 00000100:00100000:2.0:1782241212.837530:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119956736 00000100:00100000:3.0:1782241212.837640:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 137 00000100:00100000:3.0:1782241212.837705:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815119956864:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241212.837793:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241212.837831:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00080000:1.0:1782241212.837865:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782241212.837872:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782241212.837889:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119956608 00000100:00100000:1.0:1782241212.837895:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119956608 00000100:00100000:3.0:1782241212.837898:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815119956864:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 247us (8082us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241212.838269:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 305 00000100:00100000:1.0:1782241212.838280:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815119956608:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241212.838400:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815119956608:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 38us (8182us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241212.838410:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 305 00000100:00100000:1.0:1782241212.838458:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119956992 00000100:00100000:1.0:1782241212.838462:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119956992 00000100:00100000:2.0:1782241212.838543:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 138 00000100:00100000:2.0:1782241212.838554:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2396:x1868815119956736:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241212.838589:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2396:x1868815119956736:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 39us (8418us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241212.838598:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 138 00000100:00100000:2.0:1782241212.838616:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 139 00000100:00100000:2.0:1782241212.838623:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2397:x1868815119957120:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241212.838790:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119957248 00000100:00100000:0.0:1782241212.838796:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119957248 00000100:00100000:0.0:1782241212.838834:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119957376 00000100:00100000:0.0:1782241212.838837:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119957376 00000100:00100000:0.0:1782241212.838863:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 57 00000100:00100000:0.0:1782241212.838871:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119957248:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241212.838903:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119957248:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 34us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241212.838924:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 57 00000100:00100000:0.0:1782241212.838937:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 58 00000100:00100000:0.0:1782241212.838943:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2397:x1868815119957376:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241212.838983:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2397:x1868815119957376:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 39us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241212.839000:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 58 00000100:00100000:2.0:1782241212.839308:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2397:x1868815119957120:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 25us (8762us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241212.839326:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 139 00000100:00100000:3.0:1782241212.840476:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 137 00000100:00080000:0.0:1782241212.843873:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782241212.843889:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782241212.843895:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241212.846395:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 140 00000100:00100000:1.0:1782241212.846425:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119956992:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241212.846560:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119956992:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 150us (10082us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241212.846569:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 140 00010000:00010000:2.0:1782241213.061082:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241213.704988:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139953536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241213.705106:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241213.705204:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139953536 00000100:00100000:0.0:1782241213.705212:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139953536 00000100:00100000:0.0:1782241213.705258:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782241213.705267:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139953536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241213.705300:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782241213.705359:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139953536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241213.705367:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782241213.705414:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139953536:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782241214.086509:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241214.725426:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782241214.725454:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139953664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241214.725545:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241214.725707:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139953664 00000100:00100000:3.0:1782241214.725716:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139953664 00000100:00100000:3.0:1782241214.725795:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782241214.725805:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139953664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782241214.725835:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241214.725880:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139953664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241214.725887:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1782241214.728966:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782241214.729043:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d99bb80 x1868815139953664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241214.729070:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139953664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241214.730201:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139954176:0@lo:400:kworker.0 00000100:00100000:2.0:1782241214.730269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241214.730325:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139954688:0@lo:400:kworker.0 00000100:00100000:2.0:1782241214.730354:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241214.730385:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139955200:0@lo:400:kworker.0 00000100:00100000:2.0:1782241214.730408:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241214.730433:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1782241214.730439:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139953792:0@lo:400:kworker.0 00000100:00100000:2.0:1782241214.730467:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241214.730490:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139954304:0@lo:400:kworker.0 00000100:00100000:2.0:1782241214.730512:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241214.730527:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139954816:0@lo:400:kworker.0 00000100:00100000:2.0:1782241214.730545:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241214.730570:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139953792 00000100:00100000:2.0:1782241214.730577:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139953792 00000100:00100000:2.0:1782241214.730621:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1782241214.730629:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139953792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241214.730674:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139953792:12345-0@lo:400:kworker.0 Request processed in 45us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241214.730681:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1782241214.730725:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139953792:0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.730813:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139953920:0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.730839:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241214.730875:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139954432:0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.730895:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241214.730914:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815139954944:0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.730932:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241214.730950:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782241214.730955:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139954048:0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.730973:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241214.730985:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139954560:0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.731000:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241214.731013:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815139955072:0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.731028:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241214.731060:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139954176 00000100:00100000:0.0:1782241214.731064:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139954176 00000100:00100000:0.0:1782241214.731084:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139953920 00000100:00100000:0.0:1782241214.731086:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139953920 00000100:00100000:0.0:1782241214.731094:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139954432 00000100:00100000:0.0:1782241214.731096:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139954432 00000100:00100000:0.0:1782241214.731111:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139954944 00000100:00100000:0.0:1782241214.731113:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139954944 00000100:00100000:0.0:1782241214.731123:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139954560 00000100:00100000:0.0:1782241214.731125:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139954560 00000100:00100000:0.0:1782241214.731133:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139955072 00000100:00100000:0.0:1782241214.731135:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139955072 00000100:00100000:0.0:1782241214.731146:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782241214.731152:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f60ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139954176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.731186:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f60ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139954176:12345-0@lo:400:kworker.0 Request processed in 34us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241214.731198:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782241214.731215:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782241214.731220:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139953920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.731248:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139953920:12345-0@lo:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241214.731254:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782241214.731262:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1782241214.731267:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139954432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.731288:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139954432:12345-0@lo:400:kworker.0 Request processed in 21us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241214.731293:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1782241214.731301:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1782241214.731316:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815139954944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.731339:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815139954944:12345-0@lo:400:kworker.0 Request processed in 34us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241214.731344:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1782241214.731353:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1782241214.731358:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139954560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.731378:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139954560:12345-0@lo:400:kworker.0 Request processed in 20us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241214.731383:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1782241214.731391:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782241214.731396:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815139955072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.731415:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815139955072:12345-0@lo:400:kworker.0 Request processed in 19us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241214.731420:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782241214.731441:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139954688 00000100:00100000:0.0:1782241214.731444:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139954688 00000100:00100000:0.0:1782241214.731464:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139955200 00000100:00100000:0.0:1782241214.731466:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139955200 00000100:00100000:0.0:1782241214.731479:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139954816 00000100:00100000:0.0:1782241214.731481:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139954816 00000100:00100000:0.0:1782241214.731491:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782241214.731497:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139954688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.731526:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139954688:12345-0@lo:400:kworker.0 Request processed in 29us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241214.731531:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782241214.731545:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782241214.731549:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139955200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.731577:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139955200:12345-0@lo:400:kworker.0 Request processed in 27us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241214.731586:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782241214.731599:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139954816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241214.731636:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139954816:12345-0@lo:400:kworker.0 Request processed in 42us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241214.731742:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782241214.731819:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139954304 00000100:00100000:0.0:1782241214.731824:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139954304 00000100:00100000:0.0:1782241214.731897:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139954048 00000100:00100000:0.0:1782241214.731901:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139954048 00000100:00100000:2.0:1782241214.731950:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782241214.731959:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139954304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241214.731995:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139954304:12345-0@lo:400:kworker.0 Request processed in 39us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241214.732006:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782241214.732017:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782241214.732024:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139954048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241214.732062:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139954048:12345-0@lo:400:kworker.0 Request processed in 40us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241214.732068:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1782241214.732304:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782241214.732320:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782241214.732323:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241214.732325:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241214.732350:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139954048:0@lo:400:kworker.0 00010000:00080000:0.0:1782241214.732364:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d999f80 x1868815139954560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241214.732375:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139954560:0@lo:400:kworker.0 00010000:00080000:0.0:1782241214.732396:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4803bb80 x1868815139955072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241214.732404:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815139955072:0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.732414:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139953920:0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.732423:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139954432:0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.732435:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815139954944:0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.732474:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139954304:0@lo:400:kworker.0 00010000:00080000:0.0:1782241214.732487:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d99b480 x1868815139954816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241214.732494:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139954816:0@lo:400:kworker.0 00000100:00100000:0.0:1782241214.732505:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139954176:0@lo:400:kworker.0 00010000:00080000:0.0:1782241214.732514:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d99bb80 x1868815139954688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241214.732521:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139954688:0@lo:400:kworker.0 00010000:00080000:0.0:1782241214.732530:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4803aa00 x1868815139955200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241214.732538:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139955200:0@lo:400:kworker.0 00000100:00100000:3.0:1782241214.734114:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:3.0:1782241215.111104:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241215.237095:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139955328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241215.237180:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241215.237239:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139955456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241215.237271:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241215.237332:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139955328 00000100:00100000:0.0:1782241215.237334:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139955456 00000100:00100000:3.0:1782241215.237341:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139955328 00000100:00100000:0.0:1782241215.237348:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139955456 00000100:00100000:0.0:1782241215.237384:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782241215.237387:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782241215.237391:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139955456:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241215.237393:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139955328:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:0.0:1782241215.237414:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1782241215.237420:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782241215.237457:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139955328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241215.237464:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782241215.237465:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139955456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241215.237470:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782241215.237567:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139955328:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1782241215.237570:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d45a49c00 x1868815139955456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241215.237584:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139955456:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1782241216.136136:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782241216.288365:0:12497:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782241216.288584:0:12497:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1782241216.772938:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139955712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241216.773003:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241216.773005:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241216.773078:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139955712 00000100:00100000:3.0:1782241216.773090:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139955712 00000100:00100000:2.0:1782241216.773298:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782241216.773312:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139955712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782241216.773351:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241216.773408:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139955712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241216.773415:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1782241216.773473:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77a54e00 x1868815139955712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241216.773508:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139955712:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1782241216.773640:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241216.780833:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139955584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782241216.780913:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241216.781105:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139955584 00000100:00100000:0.0:1782241216.781114:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139955584 00000100:00100000:0.0:1782241216.781178:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782241216.781188:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139955584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782241216.781214:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1782241216.783613:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241216.786282:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139955584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5075us (5349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241216.786296:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1782241216.786373:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d45a49c00 x1868815139955584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241216.786405:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139955584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782241217.160623:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241217.955992:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241217.956062:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241217.956085:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241217.956141:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241217.956158:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241217.956176:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241217.956198:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241217.956226:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119957760 00000100:00100000:1.0:1782241217.956235:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119957760 00000100:00100000:1.0:1782241217.956299:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119958016 00000100:00100000:1.0:1782241217.956302:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119958016 00000100:00100000:1.0:1782241217.956319:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119957632 00000100:00100000:1.0:1782241217.956321:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119957632 00000100:00100000:1.0:1782241217.956332:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119957888 00000100:00100000:1.0:1782241217.956334:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119957888 00000100:00100000:1.0:1782241217.956352:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 147 00000100:00100000:1.0:1782241217.956362:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119957760:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241217.956442:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119957760:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 81us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241217.956450:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 147 00000100:00100000:1.0:1782241217.956469:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 148 00000100:00100000:1.0:1782241217.956475:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119958016:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241217.956501:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119958016:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 26us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241217.956507:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 148 00000100:00100000:1.0:1782241217.956519:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 149 00000100:00100000:1.0:1782241217.956526:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119957632:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241217.956550:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119957632:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241217.956556:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 149 00000100:00100000:1.0:1782241217.956589:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 150 00000100:00100000:1.0:1782241217.956596:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119957888:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241217.956630:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119957888:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 34us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241217.956636:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 150 00000100:00080000:1.0:1782241217.956654:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782241217.956657:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782241217.957058:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119958272 00000100:00100000:0.0:1782241217.957063:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119958272 00000100:00100000:0.0:1782241217.957190:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119958144 00000100:00100000:0.0:1782241217.957194:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119958144 00000100:00100000:0.0:1782241217.957226:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 62 00000100:00100000:0.0:1782241217.957233:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119958272:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241217.957284:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119958272:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 51us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241217.957290:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 62 00000100:00100000:0.0:1782241217.957303:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 63 00000100:00100000:0.0:1782241217.957310:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119958144:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241217.957332:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119958144:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 23us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241217.957338:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 63 00000100:00080000:1.0:1782241217.957447:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782241217.957450:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782241217.957517:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119957504 00000100:00100000:2.0:1782241217.957522:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119957504 00000100:00100000:2.0:1782241217.957647:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 307 00000100:00100000:2.0:1782241217.957656:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2399:x1868815119957504:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241217.957699:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2399:x1868815119957504:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 45us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241217.957706:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 307 00010000:00010000:3.0:1782241218.180923:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782241218.539906:0:12594:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782241218.540185:0:12594:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1782241218.822912:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139955840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241218.823033:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241218.824073:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139955840 00000100:00100000:0.0:1782241218.824083:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139955840 00000100:00100000:0.0:1782241218.824147:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782241218.824157:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139955840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241218.824195:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782241218.824297:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139955840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241218.824305:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782241218.824362:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139955840:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782241219.205176:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241219.845777:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241219.845812:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139955968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241219.845893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241219.846128:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139955968 00000100:00100000:3.0:1782241219.846135:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139955968 00000100:00100000:3.0:1782241219.846183:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782241219.846193:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7daed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139955968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782241219.846236:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241219.846281:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7daed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139955968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241219.846289:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1782241219.846471:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782241219.846646:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139956352:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.846679:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241219.846703:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815139956864:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.846727:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241219.846747:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815139957376:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.846793:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241219.846817:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1782241219.846824:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139956224:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.846844:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241219.846878:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815139956736:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.846898:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241219.846917:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815139957248:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.846952:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241219.846990:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139956352 00000100:00100000:2.0:1782241219.846995:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139956352 00000100:00100000:2.0:1782241219.847051:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782241219.847059:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139956352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.847105:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139956352:12345-0@lo:400:kworker.0 Request processed in 47us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241219.847112:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782241219.847134:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139956864 00000100:00100000:2.0:1782241219.847137:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139956864 00000100:00100000:2.0:1782241219.847164:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139957376 00000100:00100000:2.0:1782241219.847167:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139957376 00000100:00100000:2.0:1782241219.847189:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139956224 00000100:00100000:2.0:1782241219.847192:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139956224 00000100:00100000:2.0:1782241219.847201:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139956736 00000100:00100000:2.0:1782241219.847204:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139956736 00000100:00100000:2.0:1782241219.847228:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139957248 00000100:00100000:2.0:1782241219.847231:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139957248 00000100:00100000:2.0:1782241219.847245:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782241219.847250:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815139956864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.847284:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815139956864:12345-0@lo:400:kworker.0 Request processed in 33us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241219.847290:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782241219.847302:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782241219.847308:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815139957376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.847335:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815139957376:12345-0@lo:400:kworker.0 Request processed in 28us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241219.847341:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782241219.847352:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782241219.847363:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139956224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.847392:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139956224:12345-0@lo:400:kworker.0 Request processed in 34us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241219.847398:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782241219.847408:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782241219.847413:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815139956736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.847441:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815139956736:12345-0@lo:400:kworker.0 Request processed in 27us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241219.847447:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782241219.847457:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782241219.847470:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815139957248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.847501:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815139957248:12345-0@lo:400:kworker.0 Request processed in 33us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241219.847507:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1782241219.847539:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782241219.847544:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782241219.847556:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139956096:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.847587:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241219.847618:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139956608:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.847638:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241219.847654:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139957120:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.847782:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1782241219.847819:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48039180 x1868815139955968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241219.847839:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139955968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241219.847955:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139957120 00000100:00100000:3.0:1782241219.847960:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139957120 00000100:00100000:3.0:1782241219.847994:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782241219.848001:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139957120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241219.848043:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139957120:12345-0@lo:400:kworker.0 Request processed in 43us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241219.848050:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1782241219.848066:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782241219.848124:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d998a80 x1868815139957120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241219.848134:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139957120:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.848142:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1782241219.848148:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139956480:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.848172:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241219.848272:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139956608 00000100:00100000:0.0:1782241219.848276:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139956608 00000100:00100000:0.0:1782241219.848303:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782241219.848310:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139956608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241219.848358:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139956608:12345-0@lo:400:kworker.0 Request processed in 49us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241219.848372:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782241219.848432:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139956992:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.848455:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241219.848483:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139957504:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.848513:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241219.848539:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139956608:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.848564:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139956096 00000100:00100000:2.0:1782241219.848567:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139956096 00000100:00100000:2.0:1782241219.848595:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1782241219.848602:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815139956096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.848638:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815139956096:12345-0@lo:400:kworker.0 Request processed in 37us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241219.848645:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1782241219.848682:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139956224:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.848694:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815139956736:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.848705:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815139957248:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.848715:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139956352:0@lo:400:kworker.0 00010000:00080000:2.0:1782241219.848726:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d999500 x1868815139956864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241219.848735:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815139956864:0@lo:400:kworker.0 00010000:00080000:2.0:1782241219.848746:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d99aa00 x1868815139957376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241219.848781:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815139957376:0@lo:400:kworker.0 00000100:00100000:2.0:1782241219.848812:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139956096:0@lo:400:kworker.0 00000100:00100000:0.0:1782241219.848904:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139956992 00000100:00100000:0.0:1782241219.848908:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139956992 00000100:00100000:0.0:1782241219.848939:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139957504 00000100:00100000:0.0:1782241219.848943:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139957504 00000100:00100000:0.0:1782241219.848966:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782241219.848971:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139956992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241219.849008:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139956992:12345-0@lo:400:kworker.0 Request processed in 37us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241219.849015:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782241219.849028:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782241219.849034:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139957504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241219.849065:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139957504:12345-0@lo:400:kworker.0 Request processed in 31us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241219.849070:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1782241219.849197:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782241219.849202:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782241219.849239:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d99bb80 x1868815139956992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241219.849249:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139956992:0@lo:400:kworker.0 00010000:00080000:2.0:1782241219.849258:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d998380 x1868815139957504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241219.849267:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139957504:0@lo:400:kworker.0 00000100:00100000:3.0:1782241219.863984:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139956480 00000100:00100000:3.0:1782241219.864000:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139956480 00000100:00100000:3.0:1782241219.864079:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782241219.864090:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139956480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241219.864189:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139956480:12345-0@lo:400:kworker.0 Request processed in 100us (16015us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241219.864197:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782241219.864264:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139956480:0@lo:400:kworker.0 00010000:00010000:0.0:1782241220.229533:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241220.357110:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139957632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241220.357193:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241220.357334:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139957632 00000100:00100000:1.0:1782241220.357341:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139957632 00000100:00100000:1.0:1782241220.357396:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782241220.357405:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139957632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241220.357438:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241220.357484:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139957632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241220.357491:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782241220.357535:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139957632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241220.357846:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139957760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241220.357877:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241220.357957:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139957760 00000100:00100000:1.0:1782241220.357961:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139957760 00000100:00100000:1.0:1782241220.357998:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782241220.358005:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139957760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782241220.358020:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241220.358050:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139957760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241220.358065:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1782241220.358121:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7c7e5880 x1868815139957760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241220.358135:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139957760:0@lo:13:osp-pre-1-1.0 00000020:00000004:3.0:1782241220.831950:0:12691:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782241220.832217:0:12691:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782241221.253040:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241221.894065:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139957888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241221.894138:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241221.894463:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782241221.894478:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139958016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241221.894512:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241221.894585:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139957888 00000100:00100000:1.0:1782241221.894592:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139957888 00000100:00100000:1.0:1782241221.894652:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139958016 00000100:00100000:1.0:1782241221.894656:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139958016 00000100:00100000:1.0:1782241221.894674:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782241221.894683:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139957888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782241221.894713:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241221.895064:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139957888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 380us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241221.895072:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782241221.895091:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782241221.895099:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139958016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782241221.895110:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241221.895151:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139958016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241221.895158:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1782241221.895185:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782241221.895241:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7c7e5880 x1868815139958016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241221.895261:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139958016:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1782241221.895314:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d45a48000 x1868815139957888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241221.895328:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139957888:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782241222.277276:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241223.070074:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241223.070117:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241223.070164:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241223.070189:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241223.070208:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241223.070373:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119958528 00000100:00100000:0.0:1782241223.070382:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119958528 00000100:00100000:0.0:1782241223.070433:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119958784 00000100:00100000:0.0:1782241223.070436:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119958784 00000100:00100000:0.0:1782241223.070453:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119958656 00000100:00100000:0.0:1782241223.070456:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119958656 00000100:00100000:0.0:1782241223.070472:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 157 00000100:00100000:0.0:1782241223.070481:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119958528:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241223.070564:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119958528:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 83us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241223.070572:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 157 00000100:00100000:0.0:1782241223.070640:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 158 00000100:00100000:0.0:1782241223.070647:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119958784:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241223.070672:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119958784:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 26us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241223.070678:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 158 00000100:00100000:0.0:1782241223.070689:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 159 00000100:00100000:0.0:1782241223.070695:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119958656:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241223.070716:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119958656:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 21us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241223.070722:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 159 00000100:00100000:0.0:1782241223.070742:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119959040 00000100:00100000:0.0:1782241223.070746:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119959040 00000100:00100000:0.0:1782241223.070805:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00100000:0.0:1782241223.070811:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2395:x1868815119959040:12345-192.168.204.58@tcp:9:kworker.0 00000020:00000080:0.0:1782241223.070829:0:8425:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e197f0 00000100:00080000:0.0:1782241223.070838:0:8425:0:(import.c:65:import_set_state_nolock()) ffff890d4785a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782241223.070878:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1782241223.071013:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+2:2395:x1868815119959040:12345-192.168.204.58@tcp:9:kworker.0 Request processed in 187us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241223.071020:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00080000:0.0:1782241223.071036:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782241223.071046:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241223.071049:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782241223.071237:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241223.071526:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119958400 00000100:00100000:3.0:1782241223.071531:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119958400 00000100:00100000:3.0:1782241223.071573:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 309 00000100:00100000:3.0:1782241223.071580:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2399:x1868815119958400:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241223.071615:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2399:x1868815119958400:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 36us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241223.071630:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 309 00000100:00100000:2.0:1782241223.071714:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241223.071832:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241223.071931:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119959168 00000100:00100000:3.0:1782241223.071936:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119959168 00000100:00100000:3.0:1782241223.071981:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:3.0:1782241223.071987:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2395:x1868815119959168:12345-192.168.204.58@tcp:9:kworker.0 00000020:00000080:3.0:1782241223.072017:0:8746:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e197e9 00000100:00080000:3.0:1782241223.072024:0:8746:0:(import.c:65:import_set_state_nolock()) ffff890d47593800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782241223.072054:0:8746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1782241223.072159:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+2:2395:x1868815119959168:12345-192.168.204.58@tcp:9:kworker.0 Request processed in 169us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241223.072166:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00080000:2.0:1782241223.072868:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782241223.073349:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241223.073365:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119958912 00000100:00100000:0.0:1782241223.073371:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119958912 00000100:00100000:0.0:1782241223.073429:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 160 00000100:00100000:0.0:1782241223.073439:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119958912:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241223.073498:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119958912:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 61us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241223.073505:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 160 00000100:00080000:2.0:1782241223.073802:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:3.0:1782241223.095589:0:12789:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782241223.095903:0:12789:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782241223.301415:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241223.942000:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241223.942046:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139958144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782241223.948648:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241223.950000:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139958144 00000100:00100000:3.0:1782241223.950012:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139958144 00000100:00100000:3.0:1782241223.950076:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782241223.950086:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139958144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782241223.950139:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782241223.950234:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139958144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241223.950242:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782241223.950288:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139958144:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782241224.325154:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241224.965081:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782241224.965116:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139958272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241224.965192:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241224.965286:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139958272 00000100:00100000:2.0:1782241224.965294:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139958272 00000100:00100000:2.0:1782241224.965347:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782241224.965358:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139958272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782241224.965388:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241224.965435:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139958272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241224.965443:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1782241224.965466:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782241224.965493:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a39180 x1868815139958272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241224.965510:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139958272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241224.965937:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139958784:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.965976:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241224.966037:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139959296:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966063:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241224.966085:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139959808:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966104:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241224.966138:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782241224.966143:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139958400:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966167:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241224.966190:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139958912:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966209:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241224.966223:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139959424:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966238:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241224.966271:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139958528:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966291:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241224.966338:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139959040:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966357:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241224.966371:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815139959552:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966386:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241224.966402:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782241224.966406:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139958656:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966421:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241224.966435:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139959168:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966450:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241224.966462:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815139959680:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966477:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241224.966494:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139958784 00000100:00100000:0.0:1782241224.966498:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139958784 00000100:00100000:0.0:1782241224.966520:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139958528 00000100:00100000:0.0:1782241224.966522:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139958528 00000100:00100000:0.0:1782241224.966531:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139959040 00000100:00100000:0.0:1782241224.966533:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139959040 00000100:00100000:0.0:1782241224.966550:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139959552 00000100:00100000:0.0:1782241224.966553:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139959552 00000100:00100000:0.0:1782241224.966577:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139959168 00000100:00100000:0.0:1782241224.966581:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139959168 00000100:00100000:0.0:1782241224.966592:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139959680 00000100:00100000:0.0:1782241224.966594:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139959680 00000100:00100000:0.0:1782241224.966608:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782241224.966614:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139958784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966659:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139958784:12345-0@lo:400:kworker.0 Request processed in 45us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241224.966665:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782241224.966688:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782241224.966694:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139958528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966731:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139958528:12345-0@lo:400:kworker.0 Request processed in 37us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241224.966737:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782241224.966748:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782241224.966754:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139959040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966815:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139959040:12345-0@lo:400:kworker.0 Request processed in 61us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241224.966821:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782241224.966832:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1782241224.966838:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815139959552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966870:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815139959552:12345-0@lo:400:kworker.0 Request processed in 32us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241224.966876:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1782241224.966887:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782241224.966892:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139959168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966919:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139959168:12345-0@lo:400:kworker.0 Request processed in 27us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241224.966924:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782241224.966934:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1782241224.966939:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815139959680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.966968:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815139959680:12345-0@lo:400:kworker.0 Request processed in 28us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241224.966973:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1782241224.967001:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139959296 00000100:00100000:0.0:1782241224.967005:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139959296 00000100:00100000:0.0:1782241224.967030:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139959808 00000100:00100000:0.0:1782241224.967033:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139959808 00000100:00100000:0.0:1782241224.967051:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139959424 00000100:00100000:0.0:1782241224.967053:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139959424 00000100:00100000:0.0:1782241224.967064:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782241224.967069:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139959296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.967104:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139959296:12345-0@lo:400:kworker.0 Request processed in 35us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241224.967122:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782241224.967134:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782241224.967139:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139959808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.967171:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139959808:12345-0@lo:400:kworker.0 Request processed in 32us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241224.967176:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782241224.967185:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782241224.967191:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139959424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.967216:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139959424:12345-0@lo:400:kworker.0 Request processed in 25us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241224.967222:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782241224.967244:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139958400 00000100:00100000:0.0:1782241224.967247:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139958400 00000100:00100000:0.0:1782241224.967273:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1782241224.967279:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139958400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.967309:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139958400:12345-0@lo:400:kworker.0 Request processed in 31us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241224.967323:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1782241224.967353:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139958912 00000100:00100000:0.0:1782241224.967356:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139958912 00000100:00100000:0.0:1782241224.967377:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139958656 00000100:00100000:0.0:1782241224.967379:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139958656 00000100:00100000:0.0:1782241224.967389:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782241224.967395:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139958912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.967430:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139958912:12345-0@lo:400:kworker.0 Request processed in 34us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241224.967435:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782241224.967446:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782241224.967451:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139958656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.967481:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139958656:12345-0@lo:400:kworker.0 Request processed in 30us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241224.967487:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1782241224.967517:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782241224.967521:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782241224.967524:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241224.967526:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241224.967555:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139958656:0@lo:400:kworker.0 00010000:00080000:0.0:1782241224.967569:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d45a48000 x1868815139959168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241224.967579:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139959168:0@lo:400:kworker.0 00010000:00080000:0.0:1782241224.967588:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d45a49880 x1868815139959680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241224.967595:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815139959680:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.967615:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139958528:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.967625:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139959040:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.967634:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815139959552:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.967676:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139958400:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.967685:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139958912:0@lo:400:kworker.0 00010000:00080000:0.0:1782241224.967695:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d45a48380 x1868815139959424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241224.967704:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139959424:0@lo:400:kworker.0 00000100:00100000:0.0:1782241224.967713:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139958784:0@lo:400:kworker.0 00010000:00080000:0.0:1782241224.967723:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d45a48a80 x1868815139959296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241224.967731:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139959296:0@lo:400:kworker.0 00010000:00080000:0.0:1782241224.967741:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d45a48700 x1868815139959808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241224.967748:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139959808:0@lo:400:kworker.0 00000020:00000004:0.0:1782241225.110262:0:12886:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782241225.110693:0:12886:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782241225.349008:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241225.479277:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139959936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241225.479352:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241225.479609:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139959936 00000100:00100000:3.0:1782241225.479617:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139959936 00000100:00100000:3.0:1782241225.479662:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782241225.479671:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139959936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782241225.479714:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782241225.479788:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139959936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241225.479796:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782241225.479840:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139959936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241225.479946:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782241225.479956:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139960064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241225.479990:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241225.480025:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139960064 00000100:00100000:1.0:1782241225.480029:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139960064 00000100:00100000:1.0:1782241225.480060:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782241225.480074:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139960064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782241225.480090:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241225.480137:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139960064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241225.480143:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1782241225.480177:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7c7e5880 x1868815139960064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241225.480189:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139960064:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1782241226.373099:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241227.013259:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139960192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241227.013333:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241227.013681:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139960192 00000100:00100000:0.0:1782241227.013690:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139960192 00000100:00100000:0.0:1782241227.013789:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782241227.013809:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139960192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782241227.013841:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241227.013908:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139960192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241227.013915:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1782241227.013986:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782241227.014016:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47857100 x1868815139960192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241227.014033:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139960192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241227.014253:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241227.014264:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139960320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241227.014295:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241227.014357:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139960320 00000100:00100000:1.0:1782241227.014362:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139960320 00000100:00100000:1.0:1782241227.014400:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782241227.014406:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139960320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782241227.014417:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241227.014450:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139960320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241227.014457:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1782241227.014504:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782241227.014522:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47833480 x1868815139960320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241227.014534:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139960320:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1782241227.401042:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241228.193281:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241228.193477:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241228.193520:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241228.193554:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241228.193592:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241228.193632:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119959552 00000100:00100000:0.0:1782241228.193644:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119959552 00000100:00100000:0.0:1782241228.193722:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119959808 00000100:00100000:0.0:1782241228.193725:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119959808 00000100:00100000:0.0:1782241228.193741:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119959424 00000100:00100000:0.0:1782241228.193743:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119959424 00000100:00100000:0.0:1782241228.193791:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119959680 00000100:00100000:0.0:1782241228.193794:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119959680 00000100:00100000:3.0:1782241228.193812:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 167 00000100:00100000:3.0:1782241228.193827:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119959552:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241228.193912:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119959296 00000100:00100000:2.0:1782241228.193916:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119959296 00000100:00100000:3.0:1782241228.193933:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119959552:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 110us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241228.193975:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 168 00000100:00100000:0.0:1782241228.193984:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119959808:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241228.194015:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119959808:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 32us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241228.194022:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 168 00000100:00100000:0.0:1782241228.194051:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 169 00000100:00100000:0.0:1782241228.194059:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2396:x1868815119959424:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241228.194083:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2396:x1868815119959424:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 25us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241228.194112:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 169 00000100:00100000:0.0:1782241228.194125:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 170 00000100:00100000:0.0:1782241228.194131:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119959680:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241228.194155:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119959680:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 25us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241228.194160:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 170 00000100:00080000:0.0:1782241228.194180:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241228.194185:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782241228.194383:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 311 00000100:00100000:2.0:1782241228.194403:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815119959296:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241228.194440:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815119959296:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 41us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241228.200608:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 167 00000100:00100000:2.0:1782241228.200979:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 311 00010000:00010000:3.0:1782241228.422599:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782241228.558615:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 863fc9a5-c349-42ab-bac8-b8fe4972688d 00000020:00000080:2.0:1782241228.558631:0:9506:0:(genops.c:906:class_export_put()) final put ffff890d47596800/863fc9a5-c349-42ab-bac8-b8fe4972688d 00000020:00000080:3.0:1782241228.558832:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47596800/863fc9a5-c349-42ab-bac8-b8fe4972688d for lustre-OST0001 00000020:00000080:3.0:1782241228.558883:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d47593800 for lustre-OST0001 00000001:00100000:3.0:1782241228.559850:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 863fc9a5-c349-42ab-bac8-b8fe4972688d 00000020:00000080:3.0:1782241228.559857:0:8419:0:(genops.c:906:class_export_put()) final put ffff890d4785f800/863fc9a5-c349-42ab-bac8-b8fe4972688d 00000020:00000080:3.0:1782241228.559882:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d4785f800/863fc9a5-c349-42ab-bac8-b8fe4972688d for lustre-OST0000 00000020:00000080:3.0:1782241228.559912:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d4785a000 for lustre-OST0000 00000001:02000400:0.0:1782241228.700485:0:13031:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1782241229.061964:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241229.061995:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139960448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241229.062107:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241229.062393:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139960448 00000100:00100000:2.0:1782241229.062403:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139960448 00000100:00100000:2.0:1782241229.062478:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782241229.062490:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139960448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782241229.062832:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782241229.063307:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139960448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 816us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241229.063318:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782241229.063974:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139960448:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782241229.446304:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241230.085653:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139960832:0@lo:400:kworker.0 00000100:00100000:1.0:1782241230.085781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241230.085849:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139961344:0@lo:400:kworker.0 00000100:00100000:1.0:1782241230.085877:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241230.085913:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815139961856:0@lo:400:kworker.0 00000100:00100000:1.0:1782241230.085934:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241230.085967:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782241230.085973:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139960960:0@lo:400:kworker.0 00000100:00100000:1.0:1782241230.085996:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241230.086027:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139961472:0@lo:400:kworker.0 00000100:00100000:1.0:1782241230.086054:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241230.086072:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139961984:0@lo:400:kworker.0 00000100:00100000:1.0:1782241230.086093:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241230.086130:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139961344 00000100:00100000:1.0:1782241230.086140:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139961344 00000100:00100000:3.0:1782241230.086303:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139960576:0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.086343:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241230.086371:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139961088:0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.086394:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241230.086412:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139961600:0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.086433:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241230.086450:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139962112:0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.086469:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241230.086490:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782241230.086495:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139960704:0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.086516:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241230.086532:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139961216:0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.086554:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241230.086568:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815139961728:0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.086589:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241230.086616:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139960832 00000100:00100000:3.0:1782241230.086620:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139960832 00000100:00100000:3.0:1782241230.086657:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139961088 00000100:00100000:3.0:1782241230.086660:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139961088 00000100:00100000:3.0:1782241230.086688:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782241230.086697:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139960832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.086795:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139960832:12345-0@lo:400:kworker.0 Request processed in 98us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241230.086803:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782241230.086822:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1782241230.086828:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139961088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.086858:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139961088:12345-0@lo:400:kworker.0 Request processed in 30us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241230.086865:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1782241230.086883:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139960576 00000100:00100000:3.0:1782241230.086888:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139960576 00000100:00100000:3.0:1782241230.086915:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1782241230.086921:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815139960576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.086950:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815139960576:12345-0@lo:400:kworker.0 Request processed in 29us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241230.086956:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1782241230.086989:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139961472 00000100:00100000:3.0:1782241230.086993:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139961472 00000100:00100000:3.0:1782241230.087032:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139961984 00000100:00100000:3.0:1782241230.087036:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139961984 00000100:00100000:3.0:1782241230.087049:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139961600 00000100:00100000:3.0:1782241230.087051:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139961600 00000100:00100000:3.0:1782241230.087063:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139962112 00000100:00100000:3.0:1782241230.087066:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139962112 00000100:00100000:3.0:1782241230.087081:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782241230.087087:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139961472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.087120:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139961472:12345-0@lo:400:kworker.0 Request processed in 34us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241230.087134:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782241230.087144:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782241230.087150:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139961984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.087177:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139961984:12345-0@lo:400:kworker.0 Request processed in 28us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241230.087182:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782241230.087205:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782241230.087210:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139961600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.087233:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139961600:12345-0@lo:400:kworker.0 Request processed in 23us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241230.087239:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782241230.087248:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782241230.087253:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139962112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.087277:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139962112:12345-0@lo:400:kworker.0 Request processed in 24us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241230.087283:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782241230.087311:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139961856 00000100:00100000:3.0:1782241230.087315:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139961856 00000100:00100000:3.0:1782241230.087334:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139960960 00000100:00100000:3.0:1782241230.087337:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139960960 00000100:00100000:3.0:1782241230.087348:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139960704 00000100:00100000:3.0:1782241230.087362:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139960704 00000100:00100000:3.0:1782241230.087374:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139961216 00000100:00100000:3.0:1782241230.087376:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139961216 00000100:00100000:3.0:1782241230.087385:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139961728 00000100:00100000:3.0:1782241230.087388:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139961728 00000100:00100000:3.0:1782241230.087401:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1782241230.087413:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815139961856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.087445:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815139961856:12345-0@lo:400:kworker.0 Request processed in 33us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241230.087451:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1782241230.087462:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1782241230.087468:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139960960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.087496:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139960960:12345-0@lo:400:kworker.0 Request processed in 28us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241230.087502:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1782241230.087511:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1782241230.087516:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139960704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.087541:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139960704:12345-0@lo:400:kworker.0 Request processed in 25us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241230.087547:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1782241230.087556:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1782241230.087561:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139961216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.087588:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139961216:12345-0@lo:400:kworker.0 Request processed in 26us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241230.087593:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1782241230.087603:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1782241230.087609:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815139961728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.087635:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815139961728:12345-0@lo:400:kworker.0 Request processed in 26us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241230.087641:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1782241230.087697:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139960704:0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.087719:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139961216:0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.087728:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815139961728:0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.087737:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139960576:0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.087747:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139961088:0@lo:400:kworker.0 00010000:00080000:3.0:1782241230.087783:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e778dc700 x1868815139961600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241230.087794:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139961600:0@lo:400:kworker.0 00010000:00080000:3.0:1782241230.087808:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e47ae9180 x1868815139962112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241230.087816:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139962112:0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.087864:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139960960:0@lo:400:kworker.0 00010000:00080000:3.0:1782241230.087877:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e778df800 x1868815139961472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241230.088047:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139961472:0@lo:400:kworker.0 00010000:00080000:3.0:1782241230.088065:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e47ae9500 x1868815139961984/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241230.088073:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139961984:0@lo:400:kworker.0 00000100:00100000:3.0:1782241230.088086:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139960832:0@lo:400:kworker.0 00010000:00080000:3.0:1782241230.088097:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e778dce00 x1868815139961856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241230.088119:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815139961856:0@lo:400:kworker.0 00000100:00100000:1.0:1782241230.089369:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1782241230.089392:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139961344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241230.089714:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139961344:12345-0@lo:400:kworker.0 Request processed in 332us (3834us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241230.089723:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:1.0:1782241230.089797:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782241230.089806:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241230.089809:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782241230.089812:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782241230.092796:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139962240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241230.092897:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241230.093075:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139962240 00000100:00100000:1.0:1782241230.093086:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139962240 00000100:00100000:1.0:1782241230.093146:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782241230.093156:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139962240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782241230.093203:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241230.093258:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139962240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241230.093278:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:1.0:1782241230.093325:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e47aeb480 x1868815139962240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241230.093348:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139962240:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1782241230.096621:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e778dfb80 x1868815139961344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241230.096643:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139961344:0@lo:400:kworker.0 00010000:00010000:0.0:1782241230.473454:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241230.598475:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139962368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241230.598594:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241230.599510:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139962368 00000100:00100000:1.0:1782241230.599523:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139962368 00000100:00100000:1.0:1782241230.599613:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782241230.599627:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139962368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782241230.599662:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241230.599749:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139962368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241230.599790:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1782241230.600099:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e47aeb480 x1868815139962368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241230.600125:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139962368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241230.600632:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139962496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241230.600691:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241230.601078:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139962496 00000100:00100000:3.0:1782241230.601087:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139962496 00000100:00100000:3.0:1782241230.601154:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1782241230.601164:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139962496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782241230.601215:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782241230.601277:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139962496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241230.601284:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782241230.601960:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139962496:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782241231.493098:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241232.137363:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241232.137394:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139962624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782241232.137493:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241232.137621:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139962624 00000100:00100000:2.0:1782241232.137632:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139962624 00000100:00100000:2.0:1782241232.137701:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782241232.137713:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139962624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782241232.137791:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241232.138275:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139962624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 563us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241232.138288:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1782241232.138321:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782241232.138366:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77a56d80 x1868815139962624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241232.138401:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139962624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241232.142880:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139962752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241232.143180:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241232.151687:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139962752 00000100:00100000:3.0:1782241232.151708:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139962752 00000100:00100000:3.0:1782241232.152436:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782241232.152449:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139962752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782241232.152497:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241232.152635:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139962752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 188us (9454us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241232.152642:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1782241232.153267:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e47aeb480 x1868815139962752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241232.153296:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139962752:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1782241232.156384:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1782241232.395477:0:13178:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde9932be0 20000000:00000080:0.0:1782241232.395500:0:13178:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff890d478c1800 uarg=0000000000000000 20000000:01000000:0.0:1782241232.395558:0:13178:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782241232.395566:0:13178:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782241232.395646:0:13178:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1782241232.396355:0:13179:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1782241232.396542:0:13178:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782241232.408639:0:13178:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782241232.409818:0:13178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e47181200/0xc9959f2fb1e197f7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.409842:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e778f1200/0xc9959f2fb1e19787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350502a expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.409862:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e19795 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1978e expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.409869:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e778f0600/0xc9959f2fb1e197a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1979c expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.409876:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e778f1a00/0xc9959f2fb1e197b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e197aa expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.409884:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e47180200/0xc9959f2fb1e197bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e197b8 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.409891:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e197d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505069 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.409900:0:13178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e47181200/0xc9959f2fb1e197f7 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.409945:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e197d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505069 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.409972:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e197d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505069 expref: 12 pid: 6504 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241232.409987:0:13178:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1868815139962880:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241232.410120:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e47180200/0xc9959f2fb1e197bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e197b8 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.410130:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e47180200/0xc9959f2fb1e197bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e197b8 expref: 23 pid: 6504 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241232.410153:0:13178:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1868815139963008:0@lo:104: 00000100:00100000:3.0:1782241232.410195:0:13178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241232.410269:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139963008 00000100:00100000:2.0:1782241232.410289:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139963008 00000100:00100000:2.0:1782241232.410399:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782241232.410414:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+3:13178:x1868815139963008:12345-0@lo:104: 00010000:00010000:2.0:1782241232.410436:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e197b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e197bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.410568:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782241232.410576:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+3:13178:x1868815139963008:12345-0@lo:104: Request processed in 166us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241232.410587:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1782241232.410625:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241232.410632:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e197b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e197bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.410641:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e47181a00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241232.410647:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e197b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e197bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.410675:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e197b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e197bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241232.410683:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e197b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e197bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241232.410690:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782241232.410739:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e197b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e197bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.410746:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782241232.410800:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e197b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e197bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.410808:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e47181a00/0xc9959f2fb1e197b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e197bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.410825:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241232.410827:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241232.410828:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241232.410837:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782241232.410852:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139963136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241232.410893:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782241232.411117:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e778f1a00/0xc9959f2fb1e197b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e197aa expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.411129:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e778f1a00/0xc9959f2fb1e197b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e197aa expref: 23 pid: 6505 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241232.411152:0:13178:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1868815139963264:0@lo:104: 00000100:00100000:3.0:1782241232.411193:0:13178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241232.411241:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139963264 00000100:00100000:2.0:1782241232.411248:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139963264 00000100:00100000:2.0:1782241232.411287:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782241232.411295:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+3:13178:x1868815139963264:12345-0@lo:104: 00010000:00010000:2.0:1782241232.411306:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e778f1c00/0xc9959f2fb1e197aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e197b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.411369:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e778f0600/0xc9959f2fb1e197a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1979c expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.411373:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1782241232.411390:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e778f0600/0xc9959f2fb1e197a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1979c expref: 23 pid: 6503 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241232.411404:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+3:13178:x1868815139963264:12345-0@lo:104: Request processed in 103us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241232.411413:0:13178:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1868815139963392:0@lo:104: 00000100:00100000:2.0:1782241232.411421:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1782241232.411448:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241232.411456:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e778f1c00/0xc9959f2fb1e197aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e197b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241232.411459:0:13178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241232.411474:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1c00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241232.411479:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e778f1c00/0xc9959f2fb1e197aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e197b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.411488:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e778f1c00/0xc9959f2fb1e197aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e197b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241232.411496:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e778f1c00/0xc9959f2fb1e197aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e197b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.411501:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e19795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1978e expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241232.411509:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782241232.411530:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e19795 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1978e expref: 23 pid: 6505 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.411541:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e778f1c00/0xc9959f2fb1e197aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e197b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.411575:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782241232.411587:0:13178:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1868815139963520:0@lo:104: 00010000:00010000:2.0:1782241232.411594:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e778f1c00/0xc9959f2fb1e197aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e197b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.411604:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e778f1c00/0xc9959f2fb1e197aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e197b1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241232.411622:0:13178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241232.411647:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241232.411651:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241232.411653:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241232.411658:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e778f1200/0xc9959f2fb1e19787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350502a expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241232.411667:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139963392 00010000:00010000:3.0:1782241232.411674:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e778f1200/0xc9959f2fb1e19787 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350502a expref: 12 pid: 6503 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241232.411676:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139963392 00000100:00100000:3.0:1782241232.411691:0:13178:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778df800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1868815139963776:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241232.411703:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139963520 00000100:00100000:2.0:1782241232.411709:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139963520 00000100:00100000:2.0:1782241232.411732:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782241232.411739:0:13178:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d46869e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241232.411741:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:13178:x1868815139963392:12345-0@lo:104: 00010000:00010000:2.0:1782241232.411793:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e47181600/0xc9959f2fb1e1979c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e197a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241232.411814:0:13178:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1868815139963008:0@lo:104: 00000100:00100000:3.0:1782241232.411838:0:13178:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1868815139963264:0@lo:104: 00000100:00100000:3.0:1782241232.411857:0:13178:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1868815139963392:0@lo:104: 00010000:00010000:2.0:1782241232.411863:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782241232.411872:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+4:13178:x1868815139963392:12345-0@lo:104: Request processed in 133us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241232.411880:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782241232.411896:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782241232.411903:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:13178:x1868815139963520:12345-0@lo:104: 00010000:00010000:2.0:1782241232.411912:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e40031200/0xc9959f2fb1e1978e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241232.411921:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139963648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241232.411988:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241232.411994:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782241232.412003:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:62797b42-772f-434f-be35-dfdfcff291e0+3:13178:x1868815139963520:12345-0@lo:104: Request processed in 99us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241232.412012:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1782241232.412044:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782241232.412050:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e47181600/0xc9959f2fb1e1979c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e197a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.412067:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e47181600 already unused, calling callback (ffffffffc12aac20) 00000100:00100000:3.0:1782241232.412070:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139963136 10000000:00010000:2.0:1782241232.412073:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e47181600/0xc9959f2fb1e1979c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e197a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241232.412079:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139963136 00010000:00010000:2.0:1782241232.412085:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e47181600/0xc9959f2fb1e1979c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e197a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241232.412094:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e47181600/0xc9959f2fb1e1979c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e197a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241232.412100:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782241232.412116:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e47180200/0xc9959f2fb1e197bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e197b8 expref: 24 pid: 6504 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.412123:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e47181600/0xc9959f2fb1e1979c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e197a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.412132:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782241232.412158:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139963648 00010000:00010000:2.0:1782241232.412158:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e47181600/0xc9959f2fb1e1979c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e197a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241232.412166:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139963648 00010000:00010000:2.0:1782241232.412177:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e47181600/0xc9959f2fb1e1979c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e197a3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.412187:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e778f1a00/0xc9959f2fb1e197b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e197aa expref: 25 pid: 6505 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.412197:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241232.412203:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e40031200/0xc9959f2fb1e1978e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.412211:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40031200 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241232.412217:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e40031200/0xc9959f2fb1e1978e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e19795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241232.412218:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782241232.412239:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+25:3640:x1868815139963136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241232.412249:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e40031200/0xc9959f2fb1e1978e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e19795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241232.412268:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e40031200/0xc9959f2fb1e1978e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e19795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.412274:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:2.0:1782241232.412275:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782241232.412288:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e47180200/0xc9959f2fb1e197bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e197b8 expref: 25 pid: 6504 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.412299:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e40031200/0xc9959f2fb1e1978e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.412304:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e47180200/0xc9959f2fb1e197bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e197b8 expref: 25 pid: 6504 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.412315:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782241232.412324:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e40031200/0xc9959f2fb1e1978e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.412333:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e40031200/0xc9959f2fb1e1978e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19795 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.412340:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e47180200/0xc9959f2fb1e197bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e197b8 expref: 25 pid: 6504 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.412364:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241232.412366:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241232.412369:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241232.412372:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241232.412382:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241232.412396:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139963904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241232.412421:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139963136:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241232.412431:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782241232.412449:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241232.412483:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241232.412490:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139964032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241232.412519:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241232.413562:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139963904 00000100:00100000:3.0:1782241232.413571:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139963904 00010000:00010000:3.0:1782241232.413598:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e778f0600/0xc9959f2fb1e197a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1979c expref: 24 pid: 6503 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241232.413627:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782241232.413636:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139963648:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241232.413719:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139964032 00000100:00100000:2.0:1782241232.413728:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139964032 00010000:00010000:2.0:1782241232.413776:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e19795 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1978e expref: 25 pid: 6505 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241232.413815:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782241232.413824:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d998380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62797b42-772f-434f-be35-dfdfcff291e0+25:3637:x1868815139963904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241232.413838:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241232.413846:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e778f0600/0xc9959f2fb1e197a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1979c expref: 25 pid: 6503 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.413851:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241232.413861:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e778f0600/0xc9959f2fb1e197a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1979c expref: 25 pid: 6503 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.413870:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e778f1a00/0xc9959f2fb1e197b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e197aa expref: 25 pid: 6505 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.413884:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e778f0600/0xc9959f2fb1e197a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1979c expref: 25 pid: 6503 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.413889:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e778f1a00/0xc9959f2fb1e197b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e197aa expref: 25 pid: 6505 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.413922:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e778f1a00/0xc9959f2fb1e197b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e197aa expref: 24 pid: 6505 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.413926:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782241232.413973:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241232.414003:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d998380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62797b42-772f-434f-be35-dfdfcff291e0+23:3637:x1868815139963904:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241232.414012:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782241232.414043:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+22:3640:x1868815139963648:12345-0@lo:103:ldlm_bl.0 Request processed in 403us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241232.414045:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782241232.414064:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62797b42-772f-434f-be35-dfdfcff291e0+22:3637:x1868815139964032:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241232.414065:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1782241232.414085:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241232.414093:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e19795 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1978e expref: 21 pid: 6505 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.414110:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e19795 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1978e expref: 21 pid: 6505 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.414125:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241232.414136:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139963648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241232.414164:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62797b42-772f-434f-be35-dfdfcff291e0+21:3637:x1868815139964032:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241232.414180:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782241232.414243:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139964032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241232.414258:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139963904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241232.414350:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139963136:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782241232.414407:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e19795 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1978e expref: 20 pid: 6505 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241232.414418:0:13178:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1868815139963520:0@lo:104: 00000100:00100000:0.0:1782241232.419149:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241232.419343:0:13178:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1868815139962880:192.168.204.58@tcp:104: 00000100:00100000:3.0:1782241232.419356:0:13178:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778df800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1868815139963776:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241232.419390:0:13178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e47181200/0xc9959f2fb1e197f7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241232.419506:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241232.419626:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119959936 00000100:00100000:3.0:1782241232.419634:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119959936 00010000:00010000:3.0:1782241232.419667:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e197d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505069 expref: 13 pid: 6504 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241232.419697:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119960064 00000100:00100000:3.0:1782241232.419700:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119960064 00010000:00010000:3.0:1782241232.419713:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e778f1200/0xc9959f2fb1e19787 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350502a expref: 14 pid: 6503 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241232.419789:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 44 00000100:00100000:3.0:1782241232.419873:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+14:2398:x1868815119959936:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241232.419892:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241232.419899:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e197d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505069 expref: 14 pid: 6504 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.419911:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e197d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505069 expref: 14 pid: 6504 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.419929:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e197d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505069 expref: 14 pid: 6504 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.419944:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241232.420008:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2398:x1868815119959936:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 137us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241232.422189:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 45 00000100:00100000:2.0:1782241232.422227:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e477c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2399:x1868815119960064:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241232.422257:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241232.422269:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e778f1200/0xc9959f2fb1e19787 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350502a expref: 13 pid: 6503 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.422290:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e778f1200/0xc9959f2fb1e19787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350502a expref: 13 pid: 6503 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.422315:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e778f1200/0xc9959f2fb1e19787 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350502a expref: 13 pid: 6503 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.422342:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e47181200/0xc9959f2fb1e197f7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.422353:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e47181200/0xc9959f2fb1e197f7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.422378:0:10331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e47181200/0xc9959f2fb1e197f7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241232.422485:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 44 00010000:00010000:2.0:1782241232.422637:0:10331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e47181200/0xc9959f2fb1e197f7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.422648:0:10331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e47181200/0xc9959f2fb1e197f7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.422985:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e47181200/0xc9959f2fb1e197f7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.422992:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e47181200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241232.422998:0:10331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e47181200/0xc9959f2fb1e197f7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.423008:0:10331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e47181200/0xc9959f2fb1e197f7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.423355:0:13178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e47181200/0xc9959f2fb1e197f7 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241232.423365:0:13178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e47181200/0xc9959f2fb1e197f7 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.431534:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e47181200/0xc9959f2fb1e197f7 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.431567:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e47181200/0xc9959f2fb1e197f7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241232.431618:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241232.431743:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e477c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:2399:x1868815119960064:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 9530us (12229us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241232.431770:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 45 00010000:00010000:2.0:1782241232.518483:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241233.307817:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241233.307899:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241233.307924:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241233.307969:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241233.307996:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241233.308089:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119960448 00000100:00100000:1.0:1782241233.308102:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119960448 00000100:00100000:1.0:1782241233.308178:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119960704 00000100:00100000:1.0:1782241233.308182:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119960704 00000100:00100000:1.0:1782241233.308198:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119960320 00000100:00100000:1.0:1782241233.308200:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119960320 00000100:00100000:1.0:1782241233.308211:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119960576 00000100:00100000:1.0:1782241233.308213:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119960576 00000100:00100000:1.0:1782241233.308233:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 177 00000100:00100000:1.0:1782241233.308244:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119960448:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241233.308350:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119960448:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 107us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241233.308359:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 177 00000100:00100000:1.0:1782241233.308380:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 178 00000100:00100000:1.0:1782241233.308405:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119960704:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241233.308432:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119960704:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 28us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241233.308438:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 178 00000100:00100000:1.0:1782241233.308451:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 179 00000100:00100000:1.0:1782241233.308456:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119960320:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241233.308478:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119960320:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 22us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241233.308484:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 179 00000100:00100000:1.0:1782241233.308493:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 180 00000100:00100000:1.0:1782241233.308499:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119960576:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241233.308520:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119960576:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 21us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241233.308526:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 180 00000100:00080000:0.0:1782241233.309014:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241233.309020:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782241233.309177:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119960192 00000100:00100000:2.0:1782241233.309183:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119960192 00000100:00100000:2.0:1782241233.309232:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 313 00000100:00100000:2.0:1782241233.309240:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:2399:x1868815119960192:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241233.309294:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:2399:x1868815119960192:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 54us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241233.309301:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 313 00010000:00010000:3.0:1782241233.542230:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241233.628426:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241233.630290:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119960832 00000100:00100000:1.0:1782241233.630310:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119960832 00000100:00100000:1.0:1782241233.630388:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 314 00000100:00100000:1.0:1782241233.630400:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:6169:x1868815119960832:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241233.630425:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241233.630453:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e40030600/0xc9959f2fb1e197fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d33350509a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241233.630488:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e40030600/0xc9959f2fb1e197fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350509a expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241233.630513:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e40030600/0xc9959f2fb1e197fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350509a expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241233.630525:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e40030600, rc 0) 00000100:00100000:1.0:1782241233.630606:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:6169:x1868815119960832:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 Request processed in 208us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241233.630613:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 314 00000100:00100000:3.0:1782241233.636373:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241233.636753:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119960960 00000100:00100000:1.0:1782241233.637015:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119960960 00000100:00100000:1.0:1782241233.637278:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 315 00000100:00100000:1.0:1782241233.637291:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:6169:x1868815119960960:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241233.637534:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:6169:x1868815119960960:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 Request processed in 244us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241233.637544:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 315 00000100:00100000:1.0:1782241233.645329:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241233.645496:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119961088 00000100:00100000:2.0:1782241233.645516:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119961088 00000100:00100000:2.0:1782241233.645623:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 316 00000100:00100000:2.0:1782241233.645637:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:6169:x1868815119961088:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241233.645910:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:6169:x1868815119961088:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 Request processed in 273us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241233.645921:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 316 00000100:00100000:2.0:1782241233.655815:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241233.658135:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119961216 00000100:00100000:1.0:1782241233.658152:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119961216 00000100:00100000:1.0:1782241233.658223:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 317 00000100:00100000:1.0:1782241233.658233:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:6169:x1868815119961216:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241233.658250:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241233.658268:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e40031200/0xc9959f2fb1e19805 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d3335050a1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241233.658297:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e40031200/0xc9959f2fb1e19805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050a1 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241233.658326:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e40031200/0xc9959f2fb1e19805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050a1 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241233.658335:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e40031200, rc 0) 00000100:00100000:1.0:1782241233.658410:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:6169:x1868815119961216:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 Request processed in 178us (2607us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241233.658418:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 317 00000100:00100000:3.0:1782241233.663922:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241233.664018:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119961344 00000100:00100000:0.0:1782241233.664033:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119961344 00000100:00100000:0.0:1782241233.664113:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 318 00000100:00100000:0.0:1782241233.664123:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:6169:x1868815119961344:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241233.664284:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:6169:x1868815119961344:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 Request processed in 161us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241233.664294:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 318 00000100:00100000:0.0:1782241233.668349:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241233.668435:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119961472 00000100:00100000:3.0:1782241233.668453:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119961472 00000100:00100000:3.0:1782241233.668540:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 319 00000100:00100000:3.0:1782241233.668555:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:6169:x1868815119961472:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241233.668844:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:6169:x1868815119961472:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 Request processed in 290us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241233.668856:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 319 10000000:01000000:0.0:1782241234.116867:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782241234.116878:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e77a72800 from 7 10000000:01000000:0.0:1782241234.116885:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782241234.116964:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1600/0xc9959f2fb1e1980c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241234.116979:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e778f1600/0xc9959f2fb1e1980c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241234.116993:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e778f1600/0xc9959f2fb1e1980c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241234.117026:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139964160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782241234.117119:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241234.117211:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47934a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782241234.117279:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139964160 00000100:00100000:3.0:1782241234.117289:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139964160 00000100:00100000:3.0:1782241234.117357:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1782241234.117368:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b8a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139964160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241234.117385:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241234.117402:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e47180200/0xc9959f2fb1e19813 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1980c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241234.117432:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e47180200/0xc9959f2fb1e19813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1980c expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241234.117443:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e47180200/0xc9959f2fb1e19813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1980c expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241234.117453:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e47180200, rc 0) 00000100:00100000:3.0:1782241234.117511:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b8a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139964160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241234.117520:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1782241234.117648:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139964160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241234.117666:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e778f1600/0xc9959f2fb1e1980c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241234.117675:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e778f1600/0xc9959f2fb1e1980c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241234.117783:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d998380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139964288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241234.117815:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241234.117850:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241234.117937:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139964288 00000100:00100000:3.0:1782241234.117942:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139964288 00000100:00100000:3.0:1782241234.117967:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1782241234.117974:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b8a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139964288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241234.118106:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b8a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139964288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241234.118127:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1782241234.118178:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d998380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139964288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241234.118218:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139964416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241234.118271:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241234.118286:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afd240 going to sleep for 11 seconds 00000100:00100000:3.0:1782241234.118297:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139964416 00000100:00100000:3.0:1782241234.118300:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139964416 00000100:00100000:3.0:1782241234.118320:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1782241234.118327:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b8a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139964416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241234.118412:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b8a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139964416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241234.118418:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1782241234.118460:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139964416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782241234.119569:0:13233:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782241234.119951:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782241234.119985:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782241234.119999:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1600/0xc9959f2fb1e1980c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241234.120011:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e778f1600/0xc9959f2fb1e1980c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241234.120023:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782241234.120044:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e7d6df800 from 7 10000000:01000000:2.0:1782241234.120047:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782241234.120091:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861e00/0xc9959f2fb1e1981a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241234.120100:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b861e00/0xc9959f2fb1e1981a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241234.120112:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b861e00/0xc9959f2fb1e1981a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241234.120137:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139964544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782241234.120199:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241234.120249:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241234.120311:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139964544 00000100:00100000:0.0:1782241234.120318:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139964544 00000100:00100000:0.0:1782241234.120372:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1782241234.120383:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139964544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241234.120399:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241234.120414:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e19821 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1981a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241234.120439:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e19821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1981a expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241234.120450:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e19821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1981a expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241234.120461:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0000, rc 0) 00000100:00100000:0.0:1782241234.120519:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139964544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241234.120526:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1782241234.120576:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139964544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241234.120595:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b861e00/0xc9959f2fb1e1981a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19821 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241234.120604:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b861e00/0xc9959f2fb1e1981a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19821 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241234.120669:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139964672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241234.120699:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241234.120725:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d479343c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241234.120739:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139964672 00000100:00100000:0.0:1782241234.120743:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139964672 00000100:00100000:0.0:1782241234.120804:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1782241234.120812:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139964672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241234.120947:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139964672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241234.120955:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1782241234.120986:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139964672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241234.121018:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139964800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241234.121065:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241234.121081:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d479343c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241234.121094:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139964800 00000100:00100000:0.0:1782241234.121097:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139964800 00000100:00100000:0.0:1782241234.121115:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1782241234.121121:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139964800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241234.121208:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139964800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241234.121215:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1782241234.121253:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139964800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782241234.121964:0:13234:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1782241234.122041:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1782241234.122059:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782241234.122068:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861e00/0xc9959f2fb1e1981a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19821 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241234.122092:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b861e00/0xc9959f2fb1e1981a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19821 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241234.122103:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782241234.122106:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e43609000 from 7 10000000:01000000:0.0:1782241234.122108:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782241234.122138:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e19828 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241234.122145:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e19828 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241234.122155:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e19828 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241234.122173:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139964928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782241234.122214:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241234.122241:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47934e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782241234.122259:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139964928 00000100:00100000:0.0:1782241234.122264:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139964928 00000100:00100000:0.0:1782241234.122295:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1782241234.122303:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139964928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241234.122314:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241234.122328:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e778f0200/0xc9959f2fb1e1982f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19828 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241234.122349:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e778f0200/0xc9959f2fb1e1982f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19828 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241234.122372:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e778f0200/0xc9959f2fb1e1982f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19828 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241234.122382:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0200, rc 0) 00000100:00100000:0.0:1782241234.122422:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139964928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241234.122429:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1782241234.122470:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139964928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241234.122484:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e19828 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1982f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241234.122493:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e19828 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1982f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241234.122544:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139965056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241234.122568:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241234.122582:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47934e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782241234.122592:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139965056 00000100:00100000:0.0:1782241234.122595:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139965056 00000100:00100000:0.0:1782241234.122614:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1782241234.122619:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139965056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241234.122722:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139965056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241234.122730:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1782241234.122787:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139965056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241234.122828:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139965184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241234.122870:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241234.122886:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47934e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782241234.122897:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139965184 00000100:00100000:0.0:1782241234.122900:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139965184 00000100:00100000:0.0:1782241234.122919:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1782241234.122939:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139965184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241234.123017:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139965184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241234.123024:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1782241234.123065:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139965184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782241234.129514:0:13235:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1782241234.129924:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1782241234.129971:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782241234.129987:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e19828 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1982f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241234.130003:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e19828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1982f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241234.130016:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782241234.130020:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e48138000 from 7 10000000:01000000:1.0:1782241234.130023:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782241234.130082:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e19836 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241234.130092:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e19836 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241234.130105:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e19836 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241234.130139:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139965312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782241234.130249:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241234.130307:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46880b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241234.130441:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139965312 00000100:00100000:2.0:1782241234.130450:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139965312 00000100:00100000:2.0:1782241234.130518:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1782241234.130531:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139965312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241234.130548:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241234.130565:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e1983d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19836 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241234.130595:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e1983d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19836 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241234.130608:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e1983d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19836 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241234.130619:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860000, rc 0) 00000100:00100000:2.0:1782241234.130696:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139965312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241234.130712:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1782241234.131995:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139965312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241234.132027:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e19836 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1983d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241234.132039:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e19836 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1983d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241234.132137:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139965440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241234.132197:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241234.132250:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810300 going to sleep for 11 seconds 00000100:00100000:2.0:1782241234.132332:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139965440 00000100:00100000:2.0:1782241234.132340:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139965440 00000100:00100000:2.0:1782241234.132395:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1782241234.132405:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139965440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241234.132597:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139965440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241234.132606:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1782241234.132711:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139965440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241234.132749:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139965568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782241234.132857:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241234.132880:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46880780 going to sleep for 11 seconds 00000100:00100000:2.0:1782241234.134332:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139965568 00000100:00100000:2.0:1782241234.134347:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139965568 00000100:00100000:2.0:1782241234.134429:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1782241234.134441:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139965568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241234.134660:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139965568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241234.134669:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1782241234.135024:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139965568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782241234.142310:0:13237:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1782241234.143188:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1782241234.143225:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782241234.143249:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e19836 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1983d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241234.143269:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e19836 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1983d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241234.181544:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139965696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241234.181652:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241234.181843:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139965696 00000100:00100000:3.0:1782241234.181854:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139965696 00000100:00100000:3.0:1782241234.181939:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782241234.181949:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139965696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782241234.181995:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782241234.184050:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139965696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2087us (2382us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241234.184066:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782241234.187238:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139965696:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782241234.567082:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241235.204949:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139965824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782241235.205048:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241235.205159:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139965824 00000100:00100000:1.0:1782241235.205169:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139965824 00000100:00100000:1.0:1782241235.205241:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782241235.205253:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139965824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782241235.205296:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241235.205350:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139965824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241235.205359:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1782241235.205387:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782241235.205497:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e47ae9500 x1868815139965824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241235.205519:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139965824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241235.205888:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139966080:0@lo:400:kworker.0 00000100:00100000:3.0:1782241235.205944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241235.205971:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139966592:0@lo:400:kworker.0 00000100:00100000:3.0:1782241235.205995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241235.206011:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139967104:0@lo:400:kworker.0 00000100:00100000:3.0:1782241235.206035:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241235.206053:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1782241235.206059:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139965952:0@lo:400:kworker.0 00000100:00100000:3.0:1782241235.206092:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241235.206118:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139966464:0@lo:400:kworker.0 00000100:00100000:3.0:1782241235.206145:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241235.206162:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139966976:0@lo:400:kworker.0 00000100:00100000:3.0:1782241235.206186:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241235.206220:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139965952 00000100:00100000:3.0:1782241235.206225:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139965952 00000100:00100000:3.0:1782241235.206265:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1782241235.206280:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815139965952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241235.206323:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815139965952:12345-0@lo:400:kworker.0 Request processed in 44us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241235.206330:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1782241235.206366:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139966976 00000100:00100000:3.0:1782241235.206370:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139966976 00000100:00100000:3.0:1782241235.206405:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782241235.206412:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139966976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.206537:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139966080 00000100:00100000:1.0:1782241235.206542:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139966080 00000100:00100000:1.0:1782241235.206573:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139966592 00000100:00100000:1.0:1782241235.206576:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139966592 00000100:00100000:1.0:1782241235.206596:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139967104 00000100:00100000:1.0:1782241235.206599:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139967104 00000100:00100000:1.0:1782241235.206614:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1782241235.206621:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139966080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.206660:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139966080:12345-0@lo:400:kworker.0 Request processed in 39us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241235.206667:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1782241235.206783:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1782241235.206791:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139966592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.206824:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139966592:12345-0@lo:400:kworker.0 Request processed in 35us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241235.206830:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1782241235.206842:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782241235.206848:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139967104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.206877:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139967104:12345-0@lo:400:kworker.0 Request processed in 29us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241235.206883:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782241235.206926:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139966464 00000100:00100000:1.0:1782241235.206930:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139966464 00000100:00100000:1.0:1782241235.206960:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782241235.206968:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139966464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.207002:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139966464:12345-0@lo:400:kworker.0 Request processed in 35us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241235.207021:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782241235.207056:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139966208:0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.207087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241235.207109:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139966720:0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.207131:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241235.207145:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815139967232:0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.207165:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241235.207183:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782241235.207189:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139966336:0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.207209:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241235.207224:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139966848:0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.207247:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241235.207264:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139967360:0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.207283:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241235.207308:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139966208 00000100:00100000:1.0:1782241235.207311:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139966208 00000100:00100000:1.0:1782241235.207333:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1782241235.207339:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139966208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.207375:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139966208:12345-0@lo:400:kworker.0 Request processed in 36us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241235.207381:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1782241235.207400:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139966848 00000100:00100000:1.0:1782241235.207404:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139966848 00000100:00100000:3.0:1782241235.207561:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139966976:12345-0@lo:400:kworker.0 Request processed in 1149us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241235.207568:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782241235.207580:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139967360 00000100:00100000:3.0:1782241235.207583:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139967360 00000100:00100000:3.0:1782241235.207609:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782241235.207616:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139967360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241235.207644:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139967360:12345-0@lo:400:kworker.0 Request processed in 28us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241235.207650:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782241235.208352:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139965952:0@lo:400:kworker.0 00000100:00100000:3.0:1782241235.208369:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139966464:0@lo:400:kworker.0 00010000:00080000:3.0:1782241235.208383:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4803bb80 x1868815139966976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241235.208395:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139966976:0@lo:400:kworker.0 00000100:00100000:3.0:1782241235.208408:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139966080:0@lo:400:kworker.0 00000100:00100000:3.0:1782241235.208795:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139966592:0@lo:400:kworker.0 00000100:00100000:3.0:1782241235.208809:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139967104:0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.209568:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782241235.209583:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139966848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.210521:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139966848:12345-0@lo:400:kworker.0 Request processed in 95us (2425us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241235.210535:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782241235.210584:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139966720 00000100:00100000:1.0:1782241235.210593:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139966720 00000100:00100000:1.0:1782241235.210637:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139967232 00000100:00100000:1.0:1782241235.210641:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139967232 00000100:00100000:1.0:1782241235.210660:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139966336 00000100:00100000:1.0:1782241235.210664:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139966336 00000100:00100000:1.0:1782241235.211548:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1782241235.211559:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139966720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.211645:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139966720:12345-0@lo:400:kworker.0 Request processed in 88us (4513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241235.211653:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1782241235.211668:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1782241235.211871:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815139967232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.211920:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815139967232:12345-0@lo:400:kworker.0 Request processed in 247us (4754us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241235.211927:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1782241235.211940:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1782241235.211946:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139966336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.211981:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139966336:12345-0@lo:400:kworker.0 Request processed in 36us (4770us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241235.211987:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:1.0:1782241235.212020:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241235.212026:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241235.212028:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782241235.212039:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241235.212093:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139966336:0@lo:400:kworker.0 00010000:00080000:1.0:1782241235.212113:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4803a680 x1868815139966848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241235.212125:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139966848:0@lo:400:kworker.0 00010000:00080000:1.0:1782241235.212138:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47831c00 x1868815139967360/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241235.212146:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139967360:0@lo:400:kworker.0 00000100:00100000:1.0:1782241235.212160:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139966208:0@lo:400:kworker.0 00010000:00080000:1.0:1782241235.212171:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e778dd880 x1868815139966720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241235.212179:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139966720:0@lo:400:kworker.0 00010000:00080000:1.0:1782241235.212190:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48039500 x1868815139967232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241235.212200:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815139967232:0@lo:400:kworker.0 00010000:00010000:2.0:1782241235.589219:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241235.723519:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139967488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241235.723618:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241235.723736:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139967488 00000100:00100000:2.0:1782241235.723746:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139967488 00000100:00100000:2.0:1782241235.723826:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782241235.723838:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139967488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782241235.723868:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241235.723937:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139967488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241235.723959:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1782241235.724012:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d99aa00 x1868815139967488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241235.724035:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139967488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241235.724732:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241235.724748:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139967616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241235.724873:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241235.730396:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139967616 00000100:00100000:0.0:1782241235.730416:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139967616 00000100:00100000:0.0:1782241235.730515:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782241235.730529:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139967616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241235.730584:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782241235.730722:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139967616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 196us (5848us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241235.730746:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782241235.730839:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139967616:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782241236.612874:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782241237.172018:0:13377:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1782241237.254404:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139967744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241237.254514:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241237.254610:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139967744 00000100:00100000:1.0:1782241237.254619:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139967744 00000100:00100000:1.0:1782241237.254692:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782241237.254702:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139967744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782241237.254742:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241237.254820:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139967744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241237.254840:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1782241237.254876:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782241237.254918:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47850700 x1868815139967744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241237.254941:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139967744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241237.256838:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241237.256878:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139967872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782241237.256959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241237.257025:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139967872 00000100:00100000:1.0:1782241237.257032:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139967872 00000100:00100000:1.0:1782241237.257206:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782241237.257217:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139967872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782241237.257244:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241237.257360:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139967872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241237.257368:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1782241237.257399:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782241237.257432:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47850700 x1868815139967872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241237.257453:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139967872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782241237.638707:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241238.429653:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241238.429711:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241238.429787:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241238.429814:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241238.429840:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241238.429892:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119961856 00000100:00100000:2.0:1782241238.429894:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119962112 00000100:00100000:0.0:1782241238.429905:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119961856 00000100:00100000:2.0:1782241238.429906:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119962112 00000100:00100000:3.0:1782241238.429996:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119961600 00000100:00100000:3.0:1782241238.430001:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119961600 00000100:00100000:3.0:1782241238.430072:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 333 00000100:00100000:3.0:1782241238.430085:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2398:x1868815119961600:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241238.430189:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2398:x1868815119961600:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 105us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241238.430199:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 333 00000100:00100000:0.0:1782241238.431374:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119961728 00000100:00100000:0.0:1782241238.431387:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119961728 00000100:00100000:3.0:1782241238.433958:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119961984 00000100:00100000:3.0:1782241238.433981:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119961984 00000100:00100000:0.0:1782241238.435587:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 187 00000100:00100000:0.0:1782241238.435605:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119961856:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241238.435838:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119961856:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 237us (6125us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241238.435857:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 187 00000100:00100000:0.0:1782241238.435880:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 188 00000100:00100000:0.0:1782241238.435888:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2398:x1868815119961728:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241238.435918:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2398:x1868815119961728:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 31us (6103us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241238.435925:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 188 00000100:00080000:0.0:1782241238.435969:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241238.435976:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782241238.438197:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 189 00000100:00100000:3.0:1782241238.438217:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119961984:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241238.438317:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119961984:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 106us (8475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241238.438326:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 189 00000100:00100000:3.0:1782241238.438382:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 190 00000100:00100000:3.0:1782241238.438390:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119962112:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241238.438419:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119962112:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 30us (8664us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241238.438426:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 190 00010000:00010000:2.0:1782241238.662372:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241239.303401:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782241239.306651:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139968000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241239.307096:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241239.310294:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139968000 00000100:00100000:1.0:1782241239.310317:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139968000 00000100:00100000:1.0:1782241239.310451:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1782241239.310464:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139968000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782241239.310532:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1782241239.310682:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139968000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 220us (3586us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241239.310692:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782241239.310847:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139968000:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782241239.685191:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241240.325864:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241240.325901:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139968128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241240.326016:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241240.327592:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139968128 00000100:00100000:1.0:1782241240.327605:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139968128 00000100:00100000:1.0:1782241240.327682:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782241240.327697:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139968128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782241240.327738:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241240.327859:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139968128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241240.327868:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1782241240.327895:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782241240.327918:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139968640:0@lo:400:kworker.0 00000100:00100000:1.0:1782241240.327961:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241240.328138:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139968384:0@lo:400:kworker.0 00000100:00100000:2.0:1782241240.328174:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241240.328219:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815139968896:0@lo:400:kworker.0 00000100:00100000:2.0:1782241240.328258:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241240.328279:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815139969408:0@lo:400:kworker.0 00000100:00100000:2.0:1782241240.328302:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241240.328337:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1782241240.328343:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139968256:0@lo:400:kworker.0 00000100:00100000:2.0:1782241240.328375:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241240.328401:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139968768:0@lo:400:kworker.0 00000100:00100000:2.0:1782241240.328428:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241240.328449:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139969280:0@lo:400:kworker.0 00000100:00100000:2.0:1782241240.328475:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241240.328645:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139968640 00000100:00100000:2.0:1782241240.328652:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139968640 00000100:00100000:2.0:1782241240.328689:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139968384 00000100:00100000:2.0:1782241240.328693:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139968384 00000100:00100000:2.0:1782241240.328704:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139968896 00000100:00100000:2.0:1782241240.328707:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139968896 00000100:00100000:2.0:1782241240.328727:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139969408 00000100:00100000:2.0:1782241240.328730:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139969408 00000100:00100000:2.0:1782241240.328746:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1782241240.328754:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139968640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241240.328841:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139968640:12345-0@lo:400:kworker.0 Request processed in 86us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241240.328848:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1782241240.328865:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1782241240.328871:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139968384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241240.328906:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139968384:12345-0@lo:400:kworker.0 Request processed in 35us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241240.328912:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1782241240.328923:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1782241240.328929:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815139968896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241240.328959:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815139968896:12345-0@lo:400:kworker.0 Request processed in 31us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241240.328965:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1782241240.328975:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1782241240.328980:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815139969408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241240.329023:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815139969408:12345-0@lo:400:kworker.0 Request processed in 42us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241240.329041:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1782241240.329067:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139968256 00000100:00100000:2.0:1782241240.329072:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139968256 00000100:00100000:2.0:1782241240.329102:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1782241240.329108:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139968256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241240.329142:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139968256:12345-0@lo:400:kworker.0 Request processed in 34us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241240.329149:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1782241240.329182:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139969280 00000100:00100000:2.0:1782241240.329186:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139969280 00000100:00100000:2.0:1782241240.329217:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782241240.329224:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139969280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241240.329259:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139969280:12345-0@lo:400:kworker.0 Request processed in 36us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241240.329265:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782241240.329311:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139968256:0@lo:400:kworker.0 00010000:00080000:2.0:1782241240.329327:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a26a00 x1868815139969280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241240.329340:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139969280:0@lo:400:kworker.0 00000100:00100000:2.0:1782241240.329351:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139968384:0@lo:400:kworker.0 00000100:00100000:2.0:1782241240.329361:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815139968896:0@lo:400:kworker.0 00000100:00100000:2.0:1782241240.329369:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815139969408:0@lo:400:kworker.0 00000100:00100000:1.0:1782241240.330111:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139968640:0@lo:400:kworker.0 00000100:00100000:1.0:1782241240.330124:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139969152:0@lo:400:kworker.0 00000100:00100000:1.0:1782241240.330171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241240.330279:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139969664:0@lo:400:kworker.0 00000100:00100000:1.0:1782241240.330304:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241240.335517:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1782241240.335545:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139968512:0@lo:400:kworker.0 00000100:00100000:1.0:1782241240.335635:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241240.335662:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815139969024:0@lo:400:kworker.0 00000100:00100000:1.0:1782241240.335692:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241240.335713:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815139969536:0@lo:400:kworker.0 00000100:00100000:1.0:1782241240.335748:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241240.335803:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139969024 00000100:00100000:1.0:1782241240.335824:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139969024 00000100:00100000:1.0:1782241240.335884:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139969536 00000100:00100000:1.0:1782241240.335888:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139969536 00000100:00100000:1.0:1782241240.335917:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1782241240.335926:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815139969024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241240.336012:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815139969024:12345-0@lo:400:kworker.0 Request processed in 85us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241240.336021:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1782241240.336041:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1782241240.336048:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815139969536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241240.336076:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815139969536:12345-0@lo:400:kworker.0 Request processed in 28us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241240.336082:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1782241240.336104:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139968768 00000100:00100000:1.0:1782241240.336108:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139968768 00000100:00100000:1.0:1782241240.336135:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139968512 00000100:00100000:1.0:1782241240.336138:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139968512 00000100:00100000:1.0:1782241240.336152:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1782241240.336158:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139968768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241240.336204:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139968768:12345-0@lo:400:kworker.0 Request processed in 46us (7774us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241240.336210:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1782241240.336222:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1782241240.336242:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139968512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241240.336273:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139968512:12345-0@lo:400:kworker.0 Request processed in 45us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241240.336287:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1782241240.336327:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241240.336333:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782241240.336336:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782241240.336379:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793d500 x1868815139968128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241240.336409:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139968128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782241240.336456:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139968768:0@lo:400:kworker.0 00000100:00100000:1.0:1782241240.336482:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139968512:0@lo:400:kworker.0 00010000:00080000:1.0:1782241240.336493:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47850700 x1868815139969024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241240.336501:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815139969024:0@lo:400:kworker.0 00010000:00080000:1.0:1782241240.336508:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a27480 x1868815139969536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241240.336515:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815139969536:0@lo:400:kworker.0 00000100:00100000:0.0:1782241240.342121:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139969152 00000100:00100000:0.0:1782241240.342142:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139969152 00000100:00100000:0.0:1782241240.342247:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139969664 00000100:00100000:0.0:1782241240.342251:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139969664 00000100:00100000:0.0:1782241240.342308:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782241240.342328:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139969152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241240.342503:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139969152:12345-0@lo:400:kworker.0 Request processed in 184us (12331us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241240.342511:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782241240.342530:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1782241240.342537:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139969664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241240.342573:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139969664:12345-0@lo:400:kworker.0 Request processed in 37us (12268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241240.342579:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1782241240.342647:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a25500 x1868815139969152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241240.342664:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139969152:0@lo:400:kworker.0 00010000:00080000:0.0:1782241240.342678:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a24e00 x1868815139969664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241240.342686:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139969664:0@lo:400:kworker.0 00000100:00080000:1.0:1782241240.344088:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241240.344098:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782241240.710415:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241240.838581:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241240.838613:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139969792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241240.838808:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241240.839115:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241240.839128:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139969920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241240.839169:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241240.839211:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139969920 00000100:00100000:3.0:1782241240.839222:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139969920 00000100:00100000:3.0:1782241240.839286:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782241240.839297:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139969920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782241240.839333:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241240.839386:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139969920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241240.839394:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1782241240.839488:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9a300 x1868815139969920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241240.839509:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139969920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241240.839641:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139969792 00000100:00100000:0.0:1782241240.839647:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139969792 00000100:00100000:0.0:1782241240.839720:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1782241240.839728:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139969792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241240.839788:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782241240.839892:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139969792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 164us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241240.839899:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1782241240.840822:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139969792:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782241241.733042:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782241242.338186:0:13525:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 15:00:41 (1782241241) === 00000100:00100000:1.0:1782241242.372923:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139970048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782241242.372993:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241242.374289:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139970048 00000100:00100000:3.0:1782241242.374298:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139970048 00000100:00080000:1.0:1782241242.374331:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241242.374344:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782241242.374361:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139970176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241242.374366:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782241242.374376:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139970048:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782241242.374402:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1782241242.374412:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241242.374467:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139970048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241242.374475:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782241242.374490:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139970176 00000100:00100000:3.0:1782241242.374494:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139970176 00010000:00080000:1.0:1782241242.374511:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7c6e5500 x1868815139970048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241242.374516:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782241242.374521:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139970176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782241242.374530:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241242.374530:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139970048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241242.374560:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139970176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241242.374566:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1782241242.374568:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47a9a300 x1868815139970176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241242.374580:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139970176:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1782241242.374699:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241242.636531:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241242.636657:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241242.636796:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119962368 00000100:00100000:1.0:1782241242.636806:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119962368 00000100:00100000:1.0:1782241242.636870:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 2 00000100:00100000:1.0:1782241242.636881:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:10492:x1868815119962368:12345-192.168.204.58@tcp:700:mkdir.0 00000100:00100000:1.0:1782241242.636960:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:10492:x1868815119962368:12345-192.168.204.58@tcp:700:mkdir.0 Request processed in 81us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241242.636970:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 2 00000100:00100000:2.0:1782241242.636974:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119962240 00000100:00100000:2.0:1782241242.636980:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119962240 00000100:00100000:2.0:1782241242.637016:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00100000:2.0:1782241242.637024:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2397:x1868815119962240:12345-192.168.204.58@tcp:41:mkdir.0 00000004:00000024:2.0:1782241242.637050:0:10147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782241242.637113:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2397:x1868815119962240:12345-192.168.204.58@tcp:41:mkdir.0 Request processed in 89us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241242.637120:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00080000:3.0:1782241242.637378:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241242.640540:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241242.640716:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119962624 00000100:00100000:1.0:1782241242.640726:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119962624 00000100:00100000:1.0:1782241242.640824:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:1.0:1782241242.640834:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:10492:x1868815119962624:12345-192.168.204.58@tcp:36:mkdir.0 00010000:00010000:1.0:1782241242.640891:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241242.640968:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e196e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505015 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.640990:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e4bb38e00) 00010000:00010000:1.0:1782241242.641016:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241242.641118:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e19844 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641131:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e19844 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641139:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e19844 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641150:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1984b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641157:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1984b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641163:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1984b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641709:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eac00/0xc9959f2fb1e19852 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641719:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eac00/0xc9959f2fb1e19852 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641727:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eac00/0xc9959f2fb1e19852 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782241242.641743:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000083fdac97 reply state 00000000507e4ae9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eac00/0xc9959f2fb1e19852 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641809:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eac00/0xc9959f2fb1e19852 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641819:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff890e81fbc600) 00010000:00010000:1.0:1782241242.641827:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782241242.641830:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782241242.641836:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1782241242.641844:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e19844 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641851:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e19844 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641859:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e19844 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641865:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40030200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241242.641870:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e19844 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641878:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e19844 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641887:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e81fbc300) 00010000:00010000:1.0:1782241242.641889:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241242.641893:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e19844 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641900:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e19844 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782241242.641916:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000083fdac97 reply state 00000000507e4ae9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1984b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641925:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1984b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.641941:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff890e81fbc400) 00010000:00010000:1.0:1782241242.641943:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782241242.641945:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1782241242.642032:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:10492:x1868815119962624:12345-192.168.204.58@tcp:36:mkdir.0 Request processed in 1198us (1501us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1782241242.642041:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:2.0:1782241242.666034:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241242.670932:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119962752 00000100:00100000:1.0:1782241242.670959:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119962752 00000100:00100000:1.0:1782241242.671529:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:1.0:1782241242.671545:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:10493:x1868815119962752:12345-192.168.204.58@tcp:101:chmod.0 00010000:00010000:1.0:1782241242.671568:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241242.671590:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19859 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335050a8 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.671659:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19860 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.671674:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.671685:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241242.671816:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782241242.671821:0:11191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241242.671856:0:11191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.671881:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19859 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050a8 expref: 9 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.671921:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19860 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050a8 expref: 8 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.671930:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e81fbc300) 00010000:00010000:1.0:1782241242.672323:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782241242.672328:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea800, rc 0) 00000100:00100000:1.0:1782241242.672571:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:10493:x1868815119962752:12345-192.168.204.58@tcp:101:chmod.0 Request processed in 1029us (6545us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241242.672579:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:0.0:1782241242.675555:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241242.677127:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119963008 00000100:00100000:1.0:1782241242.677141:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119963008 00000100:00100000:1.0:1782241242.677202:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:1.0:1782241242.677213:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:10493:x1868815119963008:12345-192.168.204.58@tcp:36:chmod.0 00010000:00010000:1.0:1782241242.677270:0:10147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241242.677300:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19860 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050a8 expref: 8 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.677319:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e81fbc300) 00010000:00010000:1.0:1782241242.677329:0:10147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241242.677354:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19867 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.677368:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19867 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.677379:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19867 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782241242.678106:0:10147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aaed55c6 reply state 00000000ffb98745 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19867 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.678125:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19867 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.678133:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:0.0:1782241242.678136:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1782241242.678139:0:10147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782241242.678147:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1782241242.678247:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:10493:x1868815119963008:12345-192.168.204.58@tcp:36:chmod.0 Request processed in 1034us (2701us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1782241242.678257:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:0.0:1782241242.715095:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241242.715228:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119963136 00000100:00100000:2.0:1782241242.715239:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119963136 00000100:00100000:2.0:1782241242.715348:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 26 00000100:00100000:2.0:1782241242.715359:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:10494:x1868815119963136:12345-192.168.204.58@tcp:101:chown.0 00010000:00010000:2.0:1782241242.715396:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241242.715417:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e1986e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335050af expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.715487:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e19875 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.715502:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e19875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.715514:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e19875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241242.715562:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782241242.715566:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782241242.715614:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e19875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.715656:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e1986e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050af expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.715675:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e19875 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050af expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.715684:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:2.0:1782241242.715687:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782241242.715690:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860400, rc 0) 00000100:00100000:2.0:1782241242.715809:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+10:10494:x1868815119963136:12345-192.168.204.58@tcp:101:chown.0 Request processed in 396us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241242.715818:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 26 00000100:00100000:3.0:1782241242.719846:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241242.720504:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119963264 00000100:00100000:1.0:1782241242.720514:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119963264 00000100:00100000:1.0:1782241242.720603:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 27 00000100:00100000:1.0:1782241242.720614:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+10:10494:x1868815119963264:12345-192.168.204.58@tcp:101:chown.0 00010000:00010000:1.0:1782241242.720636:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241242.720658:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1987c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335050b6 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.720725:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19883 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.720740:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19883 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.720751:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19883 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.720797:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e1988a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.720804:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e1988a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.720810:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e1988a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.720888:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19891 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.720897:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.720917:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241242.721168:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782241242.721173:0:11191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241242.721262:0:11191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721276:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19883 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721282:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19883 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721289:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19883 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721294:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eae00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241242.721298:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19883 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721305:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19883 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721316:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:1.0:1782241242.721320:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241242.721324:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19883 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721330:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19883 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721356:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e1988a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721362:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e1988a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721368:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e1988a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721374:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241242.721377:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e1988a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721447:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e1988a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721459:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff890e81fbc400) 00010000:00010000:1.0:1782241242.721462:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241242.721466:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e1988a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721472:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e1988a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721500:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1987c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050b6 expref: 12 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721514:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19891 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050b6 expref: 11 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.721533:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff890e81fbc600) 00010000:00010000:1.0:1782241242.721535:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782241242.721538:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea000, rc 0) 00000100:00100000:1.0:1782241242.721605:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:10494:x1868815119963264:12345-192.168.204.58@tcp:101:chown.0 Request processed in 992us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241242.721612:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 27 00000100:00100000:0.0:1782241242.725382:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241242.725563:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119963392 00000100:00100000:1.0:1782241242.725572:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119963392 00000100:00100000:1.0:1782241242.725674:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 6 00000100:00100000:1.0:1782241242.725685:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:10494:x1868815119963392:12345-192.168.204.58@tcp:900:chown.0 00000100:00100000:1.0:1782241242.725804:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:10494:x1868815119963392:12345-192.168.204.58@tcp:900:chown.0 Request processed in 121us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241242.725814:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 6 00000100:00100000:0.0:1782241242.729680:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241242.729796:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119963648 00000100:00100000:2.0:1782241242.729806:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119963648 00000100:00100000:2.0:1782241242.729868:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 28 00000100:00100000:2.0:1782241242.729879:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:10494:x1868815119963648:12345-192.168.204.58@tcp:36:chown.0 00010000:00010000:2.0:1782241242.729950:0:10147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241242.729980:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19891 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050b6 expref: 11 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.730001:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff890e81fbc600) 00010000:00010000:2.0:1782241242.730007:0:10147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241242.730030:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e19898 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.730044:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e19898 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.730068:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e19898 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782241242.737973:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1782241242.738386:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1984b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738407:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1984b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738445:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1984b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738452:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40031600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241242.738458:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1984b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738467:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1984b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738489:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff890e81fbc400) 00010000:00010000:0.0:1782241242.738492:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241242.738498:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1984b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738504:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1984b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738540:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eac00/0xc9959f2fb1e19852 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738547:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eac00/0xc9959f2fb1e19852 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738552:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eac00/0xc9959f2fb1e19852 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738558:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eac00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241242.738561:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eac00/0xc9959f2fb1e19852 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738577:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eac00/0xc9959f2fb1e19852 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738588:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff890e81fbc600) 00010000:00010000:0.0:1782241242.738591:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241242.738594:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eac00/0xc9959f2fb1e19852 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738600:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eac00/0xc9959f2fb1e19852 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738617:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19867 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738623:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19867 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738691:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19867 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738697:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241242.738701:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19867 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738707:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19867 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738715:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:0.0:1782241242.738718:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782241242.738721:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19867 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.738737:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19867 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782241242.740318:0:10147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ecf3f13b reply state 0000000070c0a36c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e19898 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.740349:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e19898 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.740358:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff890e81fbc600) 00010000:00010000:2.0:1782241242.740361:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1782241242.740366:0:10147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782241242.740380:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1782241242.740609:0:10147:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1782241242.740639:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:10494:x1868815119963648:12345-192.168.204.58@tcp:36:chown.0 Request processed in 10757us (10963us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782241242.740649:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 28 00010000:00010000:3.0:1782241242.740804:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e19898 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241242.740815:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e19898 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241242.740822:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e19898 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241242.740829:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241242.740834:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e19898 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241242.740842:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e19898 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241242.740870:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff890e81fbc600) 00010000:00010000:3.0:1782241242.740873:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782241242.740877:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e19898 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241242.740884:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e19898 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241242.758400:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241242.758549:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119963776 00000100:00100000:1.0:1782241242.758560:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119963776 00000100:00100000:1.0:1782241242.758623:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00100000:1.0:1782241242.758634:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:10495:x1868815119963776:12345-192.168.204.58@tcp:101:touch.500 00010000:00010000:1.0:1782241242.758658:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241242.758679:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1989f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335050bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.759669:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782241242.760695:0:6512:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1673us 00010000:00010000:1.0:1782241242.780240:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e198a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780266:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e198a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780286:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e198a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780303:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e198ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780310:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e198ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780317:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e198ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780743:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e198b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780784:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e198b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780794:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e198b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241242.780834:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782241242.780839:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241242.780887:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e198b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780900:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e198a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780907:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e198a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780925:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e198a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780932:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241242.780937:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e198a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780946:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e198a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780962:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:1.0:1782241242.780965:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241242.780971:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e198a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780976:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e198a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780989:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e198ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.780994:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e198ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.781000:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e198ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.781005:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eae00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241242.781008:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e198ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.781023:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e198ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.781033:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff890e81fbc300) 00010000:00010000:1.0:1782241242.781035:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241242.781038:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e198ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.781045:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e198ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.781093:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1989f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050bd expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.781110:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e198b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050bd expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.781118:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:1.0:1782241242.781120:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782241242.781124:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb600, rc 0) 00000100:00100000:1.0:1782241242.781215:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:10495:x1868815119963776:12345-192.168.204.58@tcp:101:touch.500 Request processed in 22581us (22834us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241242.781225:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00100000:0.0:1782241242.799346:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241242.801563:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119964032 00000100:00100000:2.0:1782241242.801577:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119964032 00000100:00100000:2.0:1782241242.801658:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 30 00000100:00100000:2.0:1782241242.801669:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:10495:x1868815119964032:12345-192.168.204.58@tcp:101:touch.500 00010000:00010000:2.0:1782241242.801690:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241242.801711:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e198bb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335050c4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.801870:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e198c2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.801902:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e198c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.801915:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e198c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.802297:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e198c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.802307:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e198c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.802316:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e198c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782241242.802724:0:6510:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1782241242.802922:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fada00/0xc9959f2fb1e198d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.803216:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fada00/0xc9959f2fb1e198d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.803227:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fada00/0xc9959f2fb1e198d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.803268:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e198c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.803276:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e198c2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.803283:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e198c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.803295:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861a00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241242.803300:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e198c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.803307:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e198c2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.803321:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:2.0:1782241242.803324:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241242.803328:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e198c2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.803334:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861a00/0xc9959f2fb1e198c2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782241242.803347:0:6510:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac235860 reply state 0000000053a79652 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e198c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.803358:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e198c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.803364:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7f9310e (ffff890d4781c300) 00010000:00010000:2.0:1782241242.803367:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782241242.803369:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782241242.803463:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e198bb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050c4 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.803479:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fada00/0xc9959f2fb1e198d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050c4 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.803497:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff890d4781ce00) 00010000:00010000:2.0:1782241242.803500:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241242.803502:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fada00, rc 0) 00000100:00100000:2.0:1782241242.803617:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+10:10495:x1868815119964032:12345-192.168.204.58@tcp:101:touch.500 Request processed in 1949us (4280us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1782241242.803627:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 30 00000100:00100000:0.0:1782241242.812200:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241242.812299:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119964288 00000100:00100000:2.0:1782241242.812309:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119964288 00000100:00100000:2.0:1782241242.812369:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 31 00000100:00100000:2.0:1782241242.812379:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+10:10495:x1868815119964288:12345-192.168.204.58@tcp:36:touch.500 00010000:00010000:2.0:1782241242.812456:0:10147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241242.812484:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fada00/0xc9959f2fb1e198d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050c4 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.812500:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff890d4781ce00) 00010000:00010000:2.0:1782241242.812523:0:10147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241242.812574:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e198de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.812587:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e198de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.812595:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e198de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782241242.812693:0:10147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000975f268a reply state 00000000767084a1 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e198de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.812726:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e198de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.812732:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff890d4781c000) 00010000:00010000:2.0:1782241242.812735:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782241242.812738:0:10147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782241242.812883:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:10495:x1868815119964288:12345-192.168.204.58@tcp:36:touch.500 Request processed in 504us (692us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1782241242.812890:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 31 00000100:00100000:3.0:1782241242.816179:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241242.816293:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119964416 00000100:00100000:1.0:1782241242.816302:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119964416 00000100:00100000:1.0:1782241242.816353:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 32 00000100:00100000:1.0:1782241242.816362:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:10495:x1868815119964416:12345-192.168.204.58@tcp:101:touch.500 00010000:00010000:1.0:1782241242.816410:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241242.816428:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e198e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335050cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.816481:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e198e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050cb expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.816495:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e198e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050cb expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241242.816523:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff890d4781c000) 00010000:00010000:1.0:1782241242.816527:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782241242.816530:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea800, rc 0) 00000100:00100000:1.0:1782241242.816581:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+12:10495:x1868815119964416:12345-192.168.204.58@tcp:101:touch.500 Request processed in 221us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241242.816588:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 32 00000100:00100000:0.0:1782241242.821264:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241242.821461:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119964544 00000100:00100000:2.0:1782241242.821473:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119964544 00000100:00100000:2.0:1782241242.821695:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:2.0:1782241242.821704:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1868815119964544:12345-192.168.204.58@tcp:8:touch.500 00010000:00080000:2.0:1782241242.821746:0:8425:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:2.0:1782241242.821831:0:8425:0:(genops.c:1406:class_connect()) connect: client 8052d7b9-50cc-405f-b8e0-5c9d863c1c52, cookie 0xc9959f2fb1e198ec 00002000:00100000:2.0:1782241242.821846:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8052d7b9-50cc-405f-b8e0-5c9d863c1c52/ffff890d47b7f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782241242.821867:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782241242.821968:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782241242.822003:0:8425:0:(import.c:65:import_set_state_nolock()) ffff890d47b79000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241242.822082:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2395:x1868815119964544:12345-192.168.204.58@tcp:8:touch.500 Request processed in 377us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241242.822090:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:1.0:1782241242.825263:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241242.826695:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119964672 00000100:00100000:3.0:1782241242.826710:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119964672 00000100:00080000:1.0:1782241242.826812:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782241242.826827:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:3.0:1782241242.826839:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:0:x1868815119964672:12345-192.168.204.58@tcp:2:touch.500 00000001:00080000:2.0:1782241242.836913:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:2.0:1782241242.836936:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000100:00100000:3.0:1782241242.837321:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:0:x1868815119964672:12345-192.168.204.58@tcp:2:touch.500 Request processed in 10474us (12056us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1782241242.837336:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:3.0:1782241242.843856:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241242.843967:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119964928 00000100:00100000:1.0:1782241242.843984:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119964928 00000100:00100000:1.0:1782241242.844066:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 2 00000100:00100000:1.0:1782241242.844080:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+12:10495:x1868815119964928:12345-192.168.204.58@tcp:35:touch.500 00000100:00100000:1.0:1782241242.844424:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+13:10495:x1868815119964928:12345-192.168.204.58@tcp:35:touch.500 Request processed in 346us (583us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1782241242.844432:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 2 00000100:00100000:0.0:1782241242.860118:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241242.860300:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119965056 00000100:00100000:2.0:1782241242.860320:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119965056 00000100:00100000:2.0:1782241242.860387:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 33 00000100:00100000:2.0:1782241242.860397:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+13:10496:x1868815119965056:12345-192.168.204.58@tcp:101:rm.0 00010000:00010000:2.0:1782241242.860423:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241242.860442:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fada00/0xc9959f2fb1e198f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335050d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.860503:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43facc00/0xc9959f2fb1e198fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.860526:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43facc00/0xc9959f2fb1e198fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.860537:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43facc00/0xc9959f2fb1e198fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241242.860584:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782241242.860587:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782241242.860620:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e43facc00/0xc9959f2fb1e198fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.860646:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fada00/0xc9959f2fb1e198f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050d2 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.860664:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43facc00/0xc9959f2fb1e198fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050d2 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.860672:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:2.0:1782241242.860676:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782241242.860679:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43facc00, rc 0) 00000100:00100000:2.0:1782241242.860744:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:10496:x1868815119965056:12345-192.168.204.58@tcp:101:rm.0 Request processed in 348us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241242.860751:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 33 00000100:00100000:3.0:1782241242.877472:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241242.882134:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119965312 00000100:00100000:2.0:1782241242.882459:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119965312 00000100:00100000:3.0:1782241242.888367:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 34 00000100:00100000:3.0:1782241242.888389:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:10496:x1868815119965312:12345-192.168.204.58@tcp:101:rm.0 00010000:00010000:3.0:1782241242.888410:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241242.888430:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181e00/0xc9959f2fb1e19901 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335050d9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241242.888528:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1782241242.888665:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181e00/0xc9959f2fb1e19901 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050d9 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241242.888679:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:3.0:1782241242.888682:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782241242.888687:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181e00/0xc9959f2fb1e19901 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050d9 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241242.888700:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e47181e00, rc 0) 00000100:00100000:3.0:1782241242.888801:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+15:10496:x1868815119965312:12345-192.168.204.58@tcp:101:rm.0 Request processed in 379us (11294us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1782241242.888809:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 34 00000100:00100000:3.0:1782241242.897307:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241242.897446:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119965440 00000100:00100000:1.0:1782241242.897474:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119965440 00000100:00100000:1.0:1782241242.897656:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:1.0:1782241242.897666:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+15:10496:x1868815119965440:12345-192.168.204.58@tcp:37:rm.0 00000100:00100000:1.0:1782241242.903704:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+15:10496:x1868815119965440:12345-192.168.204.58@tcp:37:rm.0 Request processed in 6028us (6394us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241242.903719:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:3.0:1782241242.908120:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241242.908469:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119965696 00000100:00100000:2.0:1782241242.908479:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119965696 00000100:00100000:2.0:1782241242.908693:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 4 00000100:00100000:2.0:1782241242.908705:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+15:10496:x1868815119965696:12345-192.168.204.58@tcp:35:rm.0 00000100:00100000:2.0:1782241242.909472:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+16:10496:x1868815119965696:12345-192.168.204.58@tcp:35:rm.0 Request processed in 767us (1359us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782241242.909483:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 4 00000100:00100000:2.0:1782241242.913414:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241242.913523:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119965952 00000100:00100000:3.0:1782241242.913533:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119965952 00000100:00100000:3.0:1782241242.913625:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 35 00000100:00100000:3.0:1782241242.913636:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+16:10496:x1868815119965952:12345-192.168.204.58@tcp:101:rm.0 00010000:00010000:3.0:1782241242.913660:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241242.913680:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181e00/0xc9959f2fb1e1990f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335050e0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241242.913823:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180a00/0xc9959f2fb1e19916 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241242.913837:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180a00/0xc9959f2fb1e19916 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241242.913848:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180a00/0xc9959f2fb1e19916 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241242.913873:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1782241242.914021:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181e00/0xc9959f2fb1e1990f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050e0 expref: 19 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241242.914040:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180a00/0xc9959f2fb1e19916 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050e0 expref: 18 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241242.914049:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:3.0:1782241242.914051:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782241242.914055:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e47180a00, rc 0) 00000100:00100000:3.0:1782241242.914133:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:10496:x1868815119965952:12345-192.168.204.58@tcp:101:rm.0 Request processed in 498us (727us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1782241242.914140:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 35 00000100:00100000:2.0:1782241242.921610:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241242.921795:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119966080 00000100:00100000:0.0:1782241242.921804:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119966080 00000100:00100000:0.0:1782241242.921858:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 36 00000100:00100000:0.0:1782241242.921868:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:10496:x1868815119966080:12345-192.168.204.58@tcp:41:rm.0 00000004:00000024:0.0:1782241242.921923:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1782241242.922359:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:10496:x1868815119966080:12345-192.168.204.58@tcp:41:rm.0 Request processed in 490us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241242.922369:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 36 00000100:00100000:1.0:1782241242.926806:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241242.926902:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119966208 00000100:00100000:0.0:1782241242.926913:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119966208 00000100:00100000:0.0:1782241242.926985:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 37 00000100:00100000:0.0:1782241242.926995:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:10496:x1868815119966208:12345-192.168.204.58@tcp:101:rm.0 00010000:00010000:0.0:1782241242.927016:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241242.927037:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19924 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335050e7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927100:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0400/0xc9959f2fb1e1992b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927114:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0400/0xc9959f2fb1e1992b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927140:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0400/0xc9959f2fb1e1992b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927169:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19932 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927176:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927182:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927288:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19939 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927298:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927304:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241242.927344:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782241242.927349:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241242.927369:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927380:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927389:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0400/0xc9959f2fb1e1992b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927405:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0400/0xc9959f2fb1e1992b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927411:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0400/0xc9959f2fb1e1992b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927417:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241242.927422:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0400/0xc9959f2fb1e1992b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927429:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0400/0xc9959f2fb1e1992b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927442:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:0.0:1782241242.927446:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241242.927451:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0400/0xc9959f2fb1e1992b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927456:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0400/0xc9959f2fb1e1992b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927472:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927478:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19932 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927484:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19932 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927489:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241242.927498:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19932 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927504:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19932 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927511:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7f9310e (ffff890d4781c300) 00010000:00010000:0.0:1782241242.927513:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241242.927517:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19932 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927521:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19932 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927547:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19924 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050e7 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927559:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050e7 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.927566:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff890d4781c000) 00010000:00010000:0.0:1782241242.927568:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782241242.927571:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1200, rc 0) 00000100:00100000:0.0:1782241242.927649:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:10496:x1868815119966208:12345-192.168.204.58@tcp:101:rm.0 Request processed in 655us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241242.927657:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 37 00000100:00100000:2.0:1782241242.931628:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241242.931879:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119966464 00000100:00100000:3.0:1782241242.931890:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119966464 00000100:00100000:3.0:1782241242.931959:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 38 00000100:00100000:3.0:1782241242.931970:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:10496:x1868815119966464:12345-192.168.204.58@tcp:36:rm.0 00010000:00010000:3.0:1782241242.932475:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782241242.932503:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19939 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050e7 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241242.932527:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e198e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050cb expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241242.932537:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff890d4781c000) 00010000:00010000:3.0:1782241242.932547:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43facc00/0xc9959f2fb1e198fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050d2 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241242.932831:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:3.0:1782241242.932835:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782241242.933014:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e19940 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.933100:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e19940 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.933117:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e19940 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.933129:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19947 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.933137:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19947 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.933316:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19947 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.933483:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1994e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.933493:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1994e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.933500:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1994e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782241242.934096:0:11191:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1782241242.934111:0:11191:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306192353349ns, next at 307192350311ns, rc = 0 00010000:00010000:0.0:1782241242.934317:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19955 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934328:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19955 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934337:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19955 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934358:0:11191:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19955 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934364:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19955 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934371:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19955 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934466:0:11191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241242.934489:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1994e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934495:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1994e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934502:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1994e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934507:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0e00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241242.934511:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1994e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934517:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1994e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934529:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff890d4781c000) 00010000:00010000:0.0:1782241242.934531:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782241242.934536:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1994e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934623:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1994e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934639:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e19940 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934645:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e19940 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934651:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e19940 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934655:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1e00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241242.934657:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e19940 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934663:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e19940 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934671:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:0.0:1782241242.934674:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241242.934677:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e19940 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934682:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e19940 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782241242.934689:0:11191:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003c897011 reply state 000000004901c83f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19947 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934699:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19947 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241242.934710:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7f9310e (ffff890d4781c300) 00010000:00010000:0.0:1782241242.934712:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782241242.934715:0:11191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782241242.934799:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241242.934806:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19955 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.934813:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241242.934816:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19955 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.934822:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19955 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.934831:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff890d4781c000) 00010000:00010000:2.0:1782241242.934833:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782241242.934835:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19955 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.934847:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19955 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.934858:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241242.934859:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241242.934861:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241242.934864:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:10496:x1868815119966464:12345-192.168.204.58@tcp:36:rm.0 Request processed in 2893us (3242us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1782241242.934872:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 38 00000100:00100000:1.0:1782241242.938441:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241242.938540:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119966720 00000100:00100000:0.0:1782241242.938551:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119966720 00000100:00100000:0.0:1782241242.938610:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:0.0:1782241242.938619:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:10496:x1868815119966720:12345-192.168.204.58@tcp:35:rm.0 00000100:00100000:0.0:1782241242.938896:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:10496:x1868815119966720:12345-192.168.204.58@tcp:35:rm.0 Request processed in 276us (463us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1782241242.938905:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:1.0:1782241242.943273:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241242.943505:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119966976 00000100:00100000:2.0:1782241242.943515:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119966976 00000100:00100000:2.0:1782241242.943576:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 39 00000100:00100000:2.0:1782241242.943586:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:10496:x1868815119966976:12345-192.168.204.58@tcp:36:rm.0 00010000:00010000:2.0:1782241242.943642:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782241242.943668:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180a00/0xc9959f2fb1e19916 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050e0 expref: 19 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.943687:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e198b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050bd expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.943697:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff890e81fbca00) 00010000:00010000:2.0:1782241242.943711:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e19875 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050af expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.943720:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:2.0:1782241242.943725:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241242.943748:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1995c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.943815:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1995c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.943840:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1995c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.943854:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19963 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.943862:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19963 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.943869:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19963 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.943956:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad000/0xc9959f2fb1e1996a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.943965:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad000/0xc9959f2fb1e1996a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.943971:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad000/0xc9959f2fb1e1996a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241242.944634:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782241242.944650:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad000/0xc9959f2fb1e1996a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.944658:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad000/0xc9959f2fb1e1996a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.944664:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad000/0xc9959f2fb1e1996a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.944668:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241242.944679:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad000/0xc9959f2fb1e1996a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.944686:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad000/0xc9959f2fb1e1996a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.944695:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff890d4781ce00) 00010000:00010000:2.0:1782241242.944697:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782241242.944701:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad000/0xc9959f2fb1e1996a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.944706:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad000/0xc9959f2fb1e1996a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.944726:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1995c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.944732:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1995c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.944736:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1995c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.944741:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241242.944743:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1995c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.944748:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1995c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.946046:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4781c700) 00010000:00010000:2.0:1782241242.946054:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241242.946070:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1995c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.946088:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1995c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782241242.946108:0:6510:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000042127a50 reply state 000000006f9a2732 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19963 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.946122:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19963 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241242.946129:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff890d4781c900) 00010000:00010000:2.0:1782241242.946131:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782241242.946134:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782241242.946394:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:10496:x1868815119966976:12345-192.168.204.58@tcp:36:rm.0 Request processed in 2804us (3127us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1782241242.946403:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 39 00000100:00100000:2.0:1782241243.549664:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241243.549715:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241243.549901:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241243.549934:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241243.549962:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241243.550026:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119967616 00000100:00100000:0.0:1782241243.550036:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119967616 00000100:00100000:0.0:1782241243.550109:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119967232 00000100:00100000:0.0:1782241243.550112:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119967232 00000100:00100000:0.0:1782241243.550132:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119967488 00000100:00100000:0.0:1782241243.550135:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119967488 00000100:00100000:0.0:1782241243.550155:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 197 00000100:00100000:0.0:1782241243.550165:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119967616:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241243.550247:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119967616:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 83us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241243.550256:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 197 00000100:00100000:0.0:1782241243.550273:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 198 00000100:00100000:0.0:1782241243.550279:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119967232:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241243.550320:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119967232:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 40us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241243.550327:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 198 00000100:00100000:0.0:1782241243.550340:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 199 00000100:00100000:0.0:1782241243.550346:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119967488:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241243.550369:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119967488:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 23us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241243.550375:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 199 00000100:00100000:3.0:1782241243.550540:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119967104 00000100:00100000:3.0:1782241243.550546:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119967104 00000100:00100000:3.0:1782241243.550590:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 335 00000100:00100000:3.0:1782241243.550599:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815119967104:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241243.550647:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815119967104:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 48us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241243.550656:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 335 00000100:00080000:2.0:1782241243.550657:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782241243.550664:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782241243.557347:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119967360 00000100:00100000:1.0:1782241243.557373:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119967360 00000100:00100000:1.0:1782241243.557464:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 80 00000100:00100000:1.0:1782241243.557475:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119967360:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241243.557578:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119967360:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 94us (7851us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241243.557587:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 80 00010000:00010000:2.0:1782241243.782912:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241244.420902:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139970304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241244.420975:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241244.421065:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139970304 00000100:00100000:3.0:1782241244.421074:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139970304 00000100:00100000:3.0:1782241244.421140:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782241244.421152:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139970304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782241244.421204:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782241244.421447:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139970304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 296us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241244.421455:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782241244.421501:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139970304:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782241244.806040:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241245.445077:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139970432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241245.445205:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1782241245.445488:0:9979:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 308703729911ns, next at 309703726706ns, rc = 0 00000100:00100000:1.0:1782241245.446551:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139970560:0@lo:400:kworker.0 00000100:00100000:1.0:1782241245.446624:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241245.446673:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782241245.446679:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139970688:0@lo:400:kworker.0 00000100:00100000:1.0:1782241245.446720:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241245.446804:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139970560 00000100:00100000:1.0:1782241245.446815:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139970560 00000100:00100000:1.0:1782241245.446878:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1782241245.446889:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815139970560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241245.446953:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815139970560:12345-0@lo:400:kworker.0 Request processed in 65us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241245.446962:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1782241245.447004:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139970816:0@lo:400:kworker.0 00000100:00100000:1.0:1782241245.447034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241245.447083:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139970560:0@lo:400:kworker.0 00000100:00100000:0.0:1782241245.449305:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139970432 00000100:00100000:0.0:1782241245.449325:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139970432 00000100:00100000:0.0:1782241245.449553:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782241245.449567:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139970432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782241245.449799:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241245.449943:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139970432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 379us (4737us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241245.449951:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782241245.449986:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139970688 00000100:00100000:0.0:1782241245.449992:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139970688 00000100:00100000:0.0:1782241245.450040:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1782241245.450048:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139970688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241245.450100:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139970688:12345-0@lo:400:kworker.0 Request processed in 54us (3379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241245.450106:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1782241245.450136:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139970816 00000100:00100000:0.0:1782241245.450141:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139970816 00000100:00100000:0.0:1782241245.450170:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1782241245.450177:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139970816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241245.450221:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139970816:12345-0@lo:400:kworker.0 Request processed in 44us (3186us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241245.450227:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1782241245.450247:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782241245.450302:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139970816:0@lo:400:kworker.0 00000100:00100000:0.0:1782241245.450344:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139970688:0@lo:400:kworker.0 00010000:00080000:0.0:1782241245.450510:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7c6e7480 x1868815139970432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241245.450586:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139970432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782241245.452660:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241245.452690:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139970944:0@lo:400:kworker.0 00000100:00100000:1.0:1782241245.452804:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241245.452930:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139970944 00000100:00100000:0.0:1782241245.452939:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139970944 00000100:00100000:1.0:1782241245.453078:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1782241245.453103:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139970944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241245.453270:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139971200:0@lo:400:kworker.0 00000100:00100000:2.0:1782241245.453312:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241245.453370:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139971200 00000100:00100000:0.0:1782241245.453376:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139971200 00000100:00100000:0.0:1782241245.453416:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1782241245.453424:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4689b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139971200:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782241245.454406:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782241245.454432:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139971072:0@lo:400:kworker.0 00000100:00100000:1.0:1782241245.457587:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139970944:12345-0@lo:400:kworker.0 Request processed in 4481us (4767us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241245.457609:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1782241245.457783:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139971328:0@lo:400:kworker.0 00000100:00100000:1.0:1782241245.457867:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241245.457918:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d46898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815139971840:0@lo:400:kworker.0 00000100:00100000:1.0:1782241245.458199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241245.458255:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139970944:0@lo:400:kworker.0 00000100:00100000:1.0:1782241245.458285:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782241245.458361:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139971456:0@lo:400:kworker.0 00000100:00100000:1.0:1782241245.459044:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241245.459078:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4689b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139971968:0@lo:400:kworker.0 00000100:00100000:1.0:1782241245.459103:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241245.459148:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139971456 00000100:00100000:1.0:1782241245.459156:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139971456 00000100:00100000:1.0:1782241245.459221:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139971968 00000100:00100000:1.0:1782241245.459225:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139971968 00000100:00100000:1.0:1782241245.459251:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782241245.459259:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139971456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241245.460081:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d46898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139971712:0@lo:400:kworker.0 00000100:00100000:2.0:1782241245.460130:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241245.460209:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139971328 00000100:00100000:0.0:1782241245.460218:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139971328 00000100:00100000:0.0:1782241245.460254:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139971840 00000100:00100000:0.0:1782241245.460258:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139971840 00000100:00100000:0.0:1782241245.460274:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139971712 00000100:00100000:0.0:1782241245.460277:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139971712 00000100:00100000:0.0:1782241245.460296:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1782241245.460305:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139971328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241245.460491:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139971328:12345-0@lo:400:kworker.0 Request processed in 184us (2622us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241245.460499:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1782241245.460521:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1782241245.460528:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815139971840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241245.460582:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815139971840:12345-0@lo:400:kworker.0 Request processed in 51us (2380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241245.460590:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1782241245.460605:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1782241245.460612:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139971712:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1782241245.460647:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793c380 x1868815139971328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241245.460658:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139971712:12345-0@lo:400:kworker.0 Request processed in 44us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241245.460667:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1782241245.460669:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139971328:0@lo:400:kworker.0 00010000:00080000:2.0:1782241245.460689:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d46898700 x1868815139971840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241245.460699:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d46898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815139971840:0@lo:400:kworker.0 00000100:00100000:0.0:1782241245.460722:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d46898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139971712:0@lo:400:kworker.0 00000100:00100000:0.0:1782241245.460801:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4689b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139971200:12345-0@lo:400:kworker.0 Request processed in 7378us (7489us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241245.460809:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1782241245.460858:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241245.460864:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241245.460867:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782241245.460870:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241245.460884:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782241245.460893:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139971968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241245.460954:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139971968:12345-0@lo:400:kworker.0 Request processed in 61us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241245.460970:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782241245.461003:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139971200:0@lo:400:kworker.0 00010000:00080000:2.0:1782241245.461031:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4689b480 x1868815139971968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241245.461042:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4689b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139971968:0@lo:400:kworker.0 00000100:00100000:3.0:1782241245.462422:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241245.462552:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4689a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139971584:0@lo:400:kworker.0 00000100:00100000:3.0:1782241245.462598:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241245.463270:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139971456:12345-0@lo:400:kworker.0 Request processed in 4005us (4220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241245.463545:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782241245.463588:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139971584 00000100:00100000:1.0:1782241245.463597:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139971584 00000100:00100000:1.0:1782241245.463804:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782241245.463816:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139971584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241245.463889:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139971584:12345-0@lo:400:kworker.0 Request processed in 77us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241245.463896:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1782241245.463951:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4689a300 x1868815139971584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241245.463967:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4689a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139971584:0@lo:400:kworker.0 00000100:00080000:1.0:1782241245.463994:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782241245.464020:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793d500 x1868815139971456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241245.464031:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139971456:0@lo:400:kworker.0 00000100:00100000:2.0:1782241245.464627:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139971072 00000100:00100000:2.0:1782241245.464636:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139971072 00000100:00100000:2.0:1782241245.464693:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1782241245.464716:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139971072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241245.464833:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139971072:12345-0@lo:400:kworker.0 Request processed in 131us (2418us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241245.464840:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1782241245.464951:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139971072:0@lo:400:kworker.0 00010000:00010000:2.0:1782241245.831378:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241245.957394:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241245.957674:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241245.957715:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139972224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241245.957857:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241245.958446:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139972224 00000100:00100000:1.0:1782241245.958460:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139972224 00000100:00100000:1.0:1782241245.958539:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782241245.958550:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4689b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139972224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782241245.958584:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241245.958650:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4689b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139972224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241245.958658:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1782241245.958806:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48039500 x1868815139972224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241245.958839:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139972224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241245.959321:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139972096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241245.959374:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241245.959500:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139972096 00000100:00100000:1.0:1782241245.959507:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139972096 00000100:00100000:1.0:1782241245.959548:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1782241245.959556:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139972096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241245.959595:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241245.959643:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139972096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241245.959650:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1782241245.959796:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139972096:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782241246.861076:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782241247.095129:0:13673:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1782241247.493809:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782241247.493833:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139972352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782241247.493904:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241247.494279:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139972352 00000100:00100000:1.0:1782241247.494287:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139972352 00000100:00100000:1.0:1782241247.494445:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782241247.494456:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139972352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782241247.494486:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241247.494536:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139972352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241247.494544:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:1.0:1782241247.494608:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e43f32680 x1868815139972352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241247.494627:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139972352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782241247.494892:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1782241247.495031:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241247.495288:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139972480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782241247.495402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241247.496783:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139972480 00000100:00100000:0.0:1782241247.496795:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139972480 00000100:00100000:0.0:1782241247.496878:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782241247.496887:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139972480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782241247.496909:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241247.496992:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139972480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241247.496999:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1782241247.497041:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48039500 x1868815139972480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241247.497079:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139972480:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1782241247.497451:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782241247.880304:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782241248.238181:0:13721:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6bbb1820 20000000:00000080:0.0:1782241248.238199:0:13721:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff890d47b6d000 uarg=0000000000000000 20000000:01000000:0.0:1782241248.238244:0:13721:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1782241248.238251:0:13721:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1782241248.238257:0:13721:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1782241248.238688:0:13722:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1782241248.239092:0:13721:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1782241248.245917:0:13721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1782241248.245976:0:13721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1782241248.245996:0:13721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1782241248.246019:0:13721:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782241248.246040:0:13721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e19971 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.246063:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e40030600/0xc9959f2fb1e197fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350509a expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.246073:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e40031200/0xc9959f2fb1e19805 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050a1 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.246081:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e47180200/0xc9959f2fb1e19813 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1980c expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.246088:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e19821 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1981a expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.246094:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e778f0200/0xc9959f2fb1e1982f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19828 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.246106:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e1983d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19836 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.246115:0:13721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e19971 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.246173:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e1983d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19836 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.246192:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e1983d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19836 expref: 23 pid: 6505 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241248.246208:0:13721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f32680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1868815139972608:0@lo:104: 00000100:00100000:1.0:1782241248.246280:0:13721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782241248.246344:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e778f0200/0xc9959f2fb1e1982f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e19828 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.246352:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e778f0200/0xc9959f2fb1e1982f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e19828 expref: 23 pid: 6505 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241248.246360:0:13721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1868815139972736:0@lo:104: 00010000:00010000:1.0:1782241248.246387:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e19821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1981a expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.246395:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e19821 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1981a expref: 23 pid: 6503 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241248.246403:0:13721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f33100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1868815139972864:0@lo:104: 00010000:00010000:1.0:1782241248.246429:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e47180200/0xc9959f2fb1e19813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1980c expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.246438:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff890e47180200/0xc9959f2fb1e19813 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1980c expref: 23 pid: 6504 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241248.246446:0:13721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1868815139972992:0@lo:104: 00010000:00010000:1.0:1782241248.246483:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e40031200/0xc9959f2fb1e19805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050a1 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.246494:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e40031200/0xc9959f2fb1e19805 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050a1 expref: 12 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241248.246502:0:13721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1868815139973120:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241248.246561:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e40030600/0xc9959f2fb1e197fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350509a expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.246569:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e40030600/0xc9959f2fb1e197fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350509a expref: 12 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241248.246576:0:13721:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f32a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1868815139973248:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241248.246597:0:13721:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863240 going to sleep for 11 seconds 00000100:00100000:3.0:1782241248.247022:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782241248.247042:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241248.247068:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241248.247076:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241248.247084:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139972608 00000100:00100000:3.0:1782241248.247089:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139972608 00000100:00100000:3.0:1782241248.247123:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139972736 00000100:00100000:3.0:1782241248.247126:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139972736 00000100:00100000:3.0:1782241248.247135:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139972864 00000100:00100000:3.0:1782241248.247137:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139972864 00000100:00100000:3.0:1782241248.247145:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139972992 00000100:00100000:3.0:1782241248.247146:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139972992 00000100:00100000:3.0:1782241248.247158:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782241248.247166:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+6:13721:x1868815139972608:12345-0@lo:104: 00010000:00010000:3.0:1782241248.247179:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e19836 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1983d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.247250:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782241248.247257:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+6:13721:x1868815139972608:12345-0@lo:104: Request processed in 91us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241248.247264:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1782241248.247290:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241248.247298:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e19836 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1983d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241248.247305:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1782241248.247311:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40030a00 already unused, calling callback (ffffffffc12aac20) 00000100:00100000:3.0:1782241248.247316:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+5:13721:x1868815139972736:12345-0@lo:104: 10000000:00010000:0.0:1782241248.247318:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e19836 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1983d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.247324:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e19828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1982f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.247331:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e19836 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1983d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241248.247338:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e19836 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1983d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241248.247355:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782241248.247385:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e19836 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1983d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.247391:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782241248.247413:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e19836 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1983d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.247420:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e40030a00/0xc9959f2fb1e19836 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1983d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.247437:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241248.247440:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241248.247443:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e19828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1982f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.247447:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1782241248.247463:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+5:13721:x1868815139972736:12345-0@lo:104: Request processed in 148us (419us total) trans 0 rc 0/0 00010000:00010000:0.0:1782241248.247466:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1800 already unused, calling callback (ffffffffc12aac20) 00000100:00100000:3.0:1782241248.247471:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 10000000:00010000:0.0:1782241248.247472:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e19828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1982f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.247480:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e19828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1982f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241248.247487:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e19828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1982f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241248.247492:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1782241248.247496:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782241248.247503:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+4:13721:x1868815139972864:12345-0@lo:104: 00010000:00010000:3.0:1782241248.247512:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4b861e00/0xc9959f2fb1e1981a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19821 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.247513:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e19828 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1982f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.247525:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782241248.247532:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e19828 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1982f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.247538:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e19828 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1982f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.247547:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241248.247548:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241248.247550:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241248.247569:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139973376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241248.247599:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241248.247632:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241248.247646:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241248.247668:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139973504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241248.247702:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241248.247784:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139973376 00000100:00100000:0.0:1782241248.247789:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139973376 00010000:00010000:0.0:1782241248.247810:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e1983d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19836 expref: 24 pid: 6505 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241248.247836:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139973504 00000100:00100000:0.0:1782241248.247839:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139973504 00010000:00010000:0.0:1782241248.247851:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e778f0200/0xc9959f2fb1e1982f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19828 expref: 25 pid: 6505 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241248.247877:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782241248.247884:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62797b42-772f-434f-be35-dfdfcff291e0+25:3637:x1868815139973376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782241248.247895:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241248.247900:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e1983d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19836 expref: 25 pid: 6505 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.247910:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e1983d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19836 expref: 25 pid: 6505 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.247924:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241248.247955:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62797b42-772f-434f-be35-dfdfcff291e0+25:3637:x1868815139973376:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241248.247974:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782241248.247990:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782241248.247997:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815139973504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782241248.248005:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241248.248010:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e778f0200/0xc9959f2fb1e1982f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e19828 expref: 24 pid: 6505 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.248028:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e778f0200/0xc9959f2fb1e1982f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e19828 expref: 24 pid: 6505 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.248039:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241248.248069:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815139973504:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241248.248077:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782241248.248122:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139973504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241248.248134:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815139973376:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241248.248161:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782241248.248168:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+4:13721:x1868815139972864:12345-0@lo:104: Request processed in 665us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241248.248174:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782241248.248189:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782241248.248196:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+3:13721:x1868815139972992:12345-0@lo:104: 00010000:00010000:2.0:1782241248.248204:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e778f1600/0xc9959f2fb1e1980c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241248.248250:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782241248.248255:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:62797b42-772f-434f-be35-dfdfcff291e0+3:13721:x1868815139972992:12345-0@lo:104: Request processed in 61us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241248.248261:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1782241248.248426:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241248.248431:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b861e00/0xc9959f2fb1e1981a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19821 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.248437:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861e00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241248.248440:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861e00/0xc9959f2fb1e1981a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e19821 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.248447:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b861e00/0xc9959f2fb1e1981a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e19821 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241248.248453:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861e00/0xc9959f2fb1e1981a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e19821 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241248.248457:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782241248.248492:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4b861e00/0xc9959f2fb1e1981a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19821 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.248499:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241248.248515:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b861e00/0xc9959f2fb1e1981a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19821 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.248543:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b861e00/0xc9959f2fb1e1981a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19821 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.248554:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241248.248558:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e778f1600/0xc9959f2fb1e1980c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e19813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.248564:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1600 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241248.248568:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e778f1600/0xc9959f2fb1e1980c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e19813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.248575:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e778f1600/0xc9959f2fb1e1980c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e19813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241248.248582:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e778f1600/0xc9959f2fb1e1980c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e19813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241248.248588:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782241248.248603:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e778f1600/0xc9959f2fb1e1980c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.248609:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241248.248615:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e778f1600/0xc9959f2fb1e1980c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.248623:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e778f1600/0xc9959f2fb1e1980c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e19813 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.248635:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241248.248647:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241248.248658:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241248.248670:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139973760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241248.248700:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241248.248727:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241248.248732:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139973632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241248.248752:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241248.248800:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139973760 00000100:00100000:3.0:1782241248.248805:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139973760 00010000:00010000:3.0:1782241248.248821:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e47180200/0xc9959f2fb1e19813 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1980c expref: 24 pid: 6504 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241248.248838:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139973632 00000100:00100000:3.0:1782241248.248842:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139973632 00010000:00010000:3.0:1782241248.248852:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e19821 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1981a expref: 25 pid: 6503 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241248.248866:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782241248.248871:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+25:3640:x1868815139973760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782241248.248879:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241248.248883:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e47180200/0xc9959f2fb1e19813 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1980c expref: 25 pid: 6504 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.248891:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e47180200/0xc9959f2fb1e19813 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1980c expref: 25 pid: 6504 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.248903:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241248.248929:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+25:3640:x1868815139973760:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241248.248936:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782241248.248956:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782241248.248962:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139973632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782241248.248970:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241248.248974:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e19821 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1981a expref: 24 pid: 6503 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.248984:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e19821 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1981a expref: 24 pid: 6503 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.248993:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241248.249015:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139973632:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241248.249022:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782241248.249048:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139973632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241248.249057:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139973760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782241248.250133:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241248.250327:0:13721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b860000/0xc9959f2fb1e1983d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19836 expref: 23 pid: 6505 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241248.250340:0:13721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f32680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1868815139972608:0@lo:104: 00010000:00010000:1.0:1782241248.250351:0:13721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e778f0200/0xc9959f2fb1e1982f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e19828 expref: 22 pid: 6505 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241248.250359:0:13721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1868815139972736:0@lo:104: 00010000:00010000:1.0:1782241248.250368:0:13721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e19821 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1981a expref: 21 pid: 6503 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241248.250378:0:13721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f33100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1868815139972864:0@lo:104: 00010000:00010000:1.0:1782241248.250388:0:13721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e47180200/0xc9959f2fb1e19813 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1980c expref: 20 pid: 6504 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241248.250407:0:13721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1868815139972992:0@lo:104: 00000004:00080000:2.0:1782241248.252562:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1782241248.252607:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1782241248.252617:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1782241248.252739:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e198c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252751:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e198c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252791:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e198c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252797:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241248.252802:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e198c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252810:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e198c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252827:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7f9310e (ffff890d4781c300) 00010000:00010000:1.0:1782241248.252843:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241248.252849:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e198c9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252857:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e198c9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252879:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e198de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252885:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e198de lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252909:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e198de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252914:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241248.252917:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e198de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252923:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e198de lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252932:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff890d4781c000) 00010000:00010000:1.0:1782241248.252934:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241248.252937:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e198de lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252942:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e198de lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252961:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19947 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252968:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19947 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252974:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19947 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252979:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1a00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241248.252982:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19947 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.252999:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19947 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.253008:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7f9310e (ffff890d4781c300) 00010000:00010000:1.0:1782241248.253011:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241248.253014:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19947 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.253020:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19947 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.253035:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19963 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.253041:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19963 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.253047:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19963 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.253053:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43face00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241248.253056:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19963 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.253062:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19963 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.253070:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff890d4781c900) 00010000:00010000:1.0:1782241248.253072:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241248.253075:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19963 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.253088:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19963 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241248.253614:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241248.253632:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139973888:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782241248.253713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241248.253811:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139973888 00000100:00100000:0.0:1782241248.253819:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139973888 00000100:00100000:0.0:1782241248.253888:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782241248.253899:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139973888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782241248.253928:0:8747:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1782241248.253961:0:8747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a3ad7db, atime: 0x6a3ad7db, ctime: 0x6a3ad7db, blocks: 0x0 00010000:00010000:0.0:1782241248.253969:0:8747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037910b99/0xc9959f2fb1e19978 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.253985:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=311s v=(0 0) 00010000:00010000:0.0:1782241248.253990:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241248.253996:0:8747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037910b99/0xc9959f2fb1e19978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.254028:0:8747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037910b99/0xc9959f2fb1e19978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.254039:0:8747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037910b99/0xc9959f2fb1e19978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.254046:0:8747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037910b99/0xc9959f2fb1e19978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.254064:0:8747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782241248.254223:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815139973888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 326us (509us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1782241248.254231:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1782241248.254257:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782241248.254276:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:3.0:1782241248.254277:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890d4789e680/2, rc 0, transno 4294967301 00010000:00010000:0.0:1782241248.254286:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037910b99/0xc9959f2fb1e19978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241248.254287:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139973888:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782241248.254300:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241248.254304:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037910b99/0xc9959f2fb1e19978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.254314:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037910b99/0xc9959f2fb1e19978 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.254341:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037910b99/0xc9959f2fb1e19978 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.254348:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037910b99/0xc9959f2fb1e19978 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241248.254363:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241248.254365:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241248.254367:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241248.255416:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241248.255492:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241248.255621:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119967744 00000100:00100000:3.0:1782241248.255628:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119967744 00010000:00010000:3.0:1782241248.255670:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e40031200/0xc9959f2fb1e19805 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050a1 expref: 13 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241248.255703:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119967872 00000100:00100000:3.0:1782241248.255706:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119967872 00010000:00010000:3.0:1782241248.255718:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e40030600/0xc9959f2fb1e197fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350509a expref: 14 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241248.255741:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 50 00000100:00100000:3.0:1782241248.255780:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46898a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+14:2398:x1868815119967744:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241248.255793:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241248.255800:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e40031200/0xc9959f2fb1e19805 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050a1 expref: 14 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.255813:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e40031200/0xc9959f2fb1e19805 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050a1 expref: 14 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.255836:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241248.255880:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46898a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+14:2398:x1868815119967744:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 123us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241248.255888:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 50 00000100:00100000:3.0:1782241248.255905:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 51 00000100:00100000:3.0:1782241248.255911:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46899c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2398:x1868815119967872:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241248.255919:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241248.255924:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e40030600/0xc9959f2fb1e197fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350509a expref: 13 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.255933:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e40030600/0xc9959f2fb1e197fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350509a expref: 13 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.255944:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e19971 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.255952:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e19971 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.255967:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e19971 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.255981:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e19971 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.255988:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e19971 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.255994:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e19971 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.256001:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241248.256004:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e19971 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.256011:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e19971 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.256020:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e19971 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241248.256030:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241248.256052:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46899c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2398:x1868815119967872:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 140us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241248.256058:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 51 00010000:00010000:1.0:1782241248.256365:0:13721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e40031200/0xc9959f2fb1e19805 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050a1 expref: 12 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241248.256381:0:13721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1868815139973120:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241248.256392:0:13721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e40030600/0xc9959f2fb1e197fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350509a expref: 11 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241248.256401:0:13721:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f32a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1868815139973248:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241248.256432:0:13721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e19971 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.256443:0:13721:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e19971 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.256450:0:13721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e19971 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241248.256456:0:13721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e19971 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241248.666539:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241248.667033:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119968128 00000100:00100000:3.0:1782241248.667053:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119968128 00000100:00100000:3.0:1782241248.667147:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 206 00000100:00100000:3.0:1782241248.667161:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119968128:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241248.667299:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119968128:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 142us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241248.667328:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 206 00000100:00080000:0.0:1782241248.667727:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782241248.680868:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241248.680908:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241248.680932:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241248.681016:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241248.681061:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119968256 00000100:00100000:2.0:1782241248.681071:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119968256 00000100:00100000:2.0:1782241248.681138:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 84 00000100:00100000:2.0:1782241248.681149:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4689b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119968256:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241248.681226:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4689b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119968256:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 79us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241248.681234:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 84 00000100:00100000:2.0:1782241248.681259:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119968000 00000100:00100000:2.0:1782241248.681263:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119968000 00000100:00100000:2.0:1782241248.681557:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119968512 00000100:00100000:2.0:1782241248.681561:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119968512 00000100:00100000:2.0:1782241248.681583:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119968384 00000100:00100000:2.0:1782241248.681586:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119968384 00000100:00100000:2.0:1782241248.681602:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 207 00000100:00100000:2.0:1782241248.681609:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4689ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119968000:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241248.681659:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4689ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119968000:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 49us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241248.681665:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 207 00000100:00100000:2.0:1782241248.681679:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 208 00000100:00100000:2.0:1782241248.681685:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4689a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119968512:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241248.681709:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4689a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119968512:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 25us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241248.681716:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 208 00000100:00100000:2.0:1782241248.681728:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 209 00000100:00100000:2.0:1782241248.681733:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119968384:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241248.681780:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119968384:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 22us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241248.681794:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 209 00000100:00080000:2.0:1782241248.681816:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241248.681820:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782241248.681882:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782241248.900939:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782241249.213135:0:13770:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff09ee5e60 20000000:00000080:2.0:1782241249.213161:0:13770:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff890d47aca000 uarg=0000000000000000 20000000:01000000:2.0:1782241249.213221:0:13770:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1782241249.213230:0:13770:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1782241249.213235:0:13770:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1782241249.217114:0:13771:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1782241249.217267:0:13770:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1782241249.217450:0:13770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1782241249.217488:0:13770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1782241249.217505:0:13770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1782241249.217534:0:13770:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782241249.217564:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e43fad800/0xc9959f2fb1e1997f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.218435:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e43fad800/0xc9959f2fb1e1997f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.218451:0:13770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e43fad800/0xc9959f2fb1e1997f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.218459:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e43fad800/0xc9959f2fb1e1997f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.218466:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e43fad800/0xc9959f2fb1e1997f lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.218474:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e43fad800/0xc9959f2fb1e1997f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.218503:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241249.218520:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e43fad800/0xc9959f2fb1e1997f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.218530:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e43fad800/0xc9959f2fb1e1997f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.218549:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e43fad800/0xc9959f2fb1e1997f lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.218558:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e43fad800/0xc9959f2fb1e1997f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.218566:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e43fad800/0xc9959f2fb1e1997f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241249.287056:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782241249.287065:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e77a72800 from 7 10000000:01000000:3.0:1782241249.287070:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782241249.287121:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241249.287134:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241249.287146:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241249.287170:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139974016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782241249.287248:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241249.287299:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d478e9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241249.287320:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139974016 00000100:00100000:3.0:1782241249.287326:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139974016 00000100:00100000:3.0:1782241249.287370:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1782241249.287379:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+20:6508:x1868815139974016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241249.287392:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241249.287405:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e47180a00/0xc9959f2fb1e1998d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19986 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241249.287428:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e47180a00/0xc9959f2fb1e1998d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19986 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241249.287439:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e47180a00/0xc9959f2fb1e1998d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19986 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241249.287481:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e47180a00, rc 0) 00000100:00100000:3.0:1782241249.287519:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139974016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241249.287527:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1782241249.287582:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139974016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241249.287594:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1998d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241249.287603:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1998d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241249.287668:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139974144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241249.287695:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241249.287714:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d478e9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241249.289257:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139974144 00000100:00100000:1.0:1782241249.289292:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139974144 00000100:00100000:1.0:1782241249.289379:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1782241249.289394:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139974144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241249.289641:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139974144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241249.289672:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1782241249.289936:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139974144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.290353:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4689bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139974272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.290439:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241249.290522:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503a9540 going to sleep for 11 seconds 00000100:00100000:3.0:1782241249.291298:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139974272 00000100:00100000:3.0:1782241249.291307:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139974272 00000100:00100000:3.0:1782241249.291357:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1782241249.291367:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139974272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241249.291510:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139974272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241249.291519:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1782241249.292167:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4689bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139974272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.296435:0:13775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4689bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:13775:1868815139974400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241249.296526:0:13775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241249.296597:0:13775:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503a9240 going to sleep for 11 seconds 00000100:00100000:3.0:1782241249.296681:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139974400 00000100:00100000:3.0:1782241249.296690:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139974400 00000100:00100000:3.0:1782241249.296743:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1782241249.296753:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:13775:x1868815139974400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241249.298710:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:13775:x1868815139974400:12345-0@lo:502:llog_process_th.0 Request processed in 1950us (2176us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241249.298724:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1782241249.299945:0:13775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4689bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:13775:1868815139974400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782241249.299984:0:13775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241249.300000:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241249.300002:0:13775:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782241249.300008:0:13775:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890e77a72800 00000020:00000080:2.0:1782241249.300011:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782241249.300151:0:13775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241249.300155:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241249.300156:0:13775:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782241249.300159:0:13775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241249.300162:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241249.300163:0:13775:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1782241249.300167:0:13775:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890e77a72800 00000020:00000080:2.0:1782241249.300169:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782241249.300394:0:13775:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4689bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:13775:1868815139974528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241249.300453:0:13775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241249.301170:0:13775:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4c4a9900 going to sleep for 11 seconds 00000100:00100000:3.0:1782241249.301394:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139974528 00000100:00100000:3.0:1782241249.301402:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139974528 00000100:00100000:3.0:1782241249.301451:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1782241249.301459:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+21:13775:x1868815139974528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241249.301600:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+21:13775:x1868815139974528:12345-0@lo:502:llog_process_th.0 Request processed in 140us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241249.301607:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1782241249.308907:0:13775:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4689bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:13775:1868815139974528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782241249.308972:0:13775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241249.308981:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241249.308983:0:13775:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1782241249.308997:0:13775:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1782241249.309865:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1782241249.309893:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782241249.309905:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1998d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.309923:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1998d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241249.309934:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782241249.309937:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e7d6df800 from 7 10000000:01000000:2.0:1782241249.309948:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782241249.309987:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.309995:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.310006:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241249.310030:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4689bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139974656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782241249.310132:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241249.310177:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503a9240 going to sleep for 11 seconds 00000100:00100000:2.0:1782241249.310246:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139974656 00000100:00100000:2.0:1782241249.310254:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139974656 00000100:00100000:2.0:1782241249.310313:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1782241249.310323:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+21:6508:x1868815139974656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241249.310337:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241249.310351:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e43fad000/0xc9959f2fb1e1999b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e19994 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.310377:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e43fad000/0xc9959f2fb1e1999b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e19994 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.310386:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e43fad000/0xc9959f2fb1e1999b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e19994 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.310396:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad000, rc 0) 00000100:00100000:2.0:1782241249.310465:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139974656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241249.310488:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1782241249.310907:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4689bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139974656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241249.310924:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1999b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241249.310934:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1999b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241249.311000:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139974784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241249.311042:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241249.311075:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d478e9780 going to sleep for 11 seconds 00000100:00100000:2.0:1782241249.311173:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139974784 00000100:00100000:2.0:1782241249.311179:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139974784 00000100:00100000:2.0:1782241249.311217:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1782241249.311223:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139974784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.311353:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139974784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241249.311360:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1782241249.311389:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139974784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.311418:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4689aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139974912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.311455:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241249.311472:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4b25f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241249.311484:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139974912 00000100:00100000:2.0:1782241249.311487:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139974912 00000100:00100000:2.0:1782241249.311509:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1782241249.311515:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139974912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.311585:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139974912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241249.311590:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1782241249.311628:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4689aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139974912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.311958:0:13777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4689aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:13777:1868815139975040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241249.311989:0:13777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241249.312010:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139975040 00000100:00100000:2.0:1782241249.312013:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139975040 00000100:00100000:2.0:1782241249.312046:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1782241249.312051:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+22:13777:x1868815139975040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241249.312123:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+22:13777:x1868815139975040:12345-0@lo:502:llog_process_th.0 Request processed in 71us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241249.312129:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1782241249.312154:0:13777:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4b25f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241249.312165:0:13777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4689aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:13777:1868815139975040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782241249.312184:0:13777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241249.312305:0:13777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241249.312309:0:13777:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782241249.312315:0:13777:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890e7d6df800 00000020:00000080:2.0:1782241249.312317:0:13777:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782241249.312371:0:13777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241249.312375:0:13777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241249.312376:0:13777:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782241249.312378:0:13777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241249.312380:0:13777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241249.312381:0:13777:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1782241249.312384:0:13777:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890e7d6df800 00000020:00000080:2.0:1782241249.312386:0:13777:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782241249.312412:0:13777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4689aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:13777:1868815139975168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241249.312444:0:13777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241249.312464:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139975168 00000100:00100000:2.0:1782241249.312467:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139975168 00000100:00100000:2.0:1782241249.312487:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1782241249.312494:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+22:13777:x1868815139975168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241249.312557:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+22:13777:x1868815139975168:12345-0@lo:502:llog_process_th.0 Request processed in 62us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241249.312563:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1782241249.312596:0:13777:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f8f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241249.312607:0:13777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4689aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:13777:1868815139975168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782241249.312624:0:13777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241249.312628:0:13777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241249.312639:0:13777:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1782241249.312642:0:13777:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1782241249.312691:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1782241249.312714:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782241249.312723:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1999b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.312733:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1999b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241249.312743:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782241249.312746:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e43609000 from 7 10000000:01000000:2.0:1782241249.312748:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782241249.312798:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.312806:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.313117:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241249.328342:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4689aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139975296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782241249.328416:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241249.328463:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d478e9000 going to sleep for 11 seconds 00000100:00100000:0.0:1782241249.330963:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139975296 00000100:00100000:0.0:1782241249.330980:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139975296 00000100:00100000:0.0:1782241249.331925:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1782241249.331937:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+22:6508:x1868815139975296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241249.331954:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241249.331971:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e778f0400/0xc9959f2fb1e199a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e199a2 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241249.331995:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e778f0400/0xc9959f2fb1e199a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e199a2 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241249.332005:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e778f0400/0xc9959f2fb1e199a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e199a2 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241249.332013:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0400, rc 0) 00000100:00100000:0.0:1782241249.332577:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139975296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 642us (4161us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241249.332585:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1782241249.333126:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4689aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139975296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241249.333146:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e199a9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241249.333156:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e199a9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241249.334348:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139975424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241249.334409:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241249.334465:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47934e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241249.334552:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139975424 00000100:00100000:2.0:1782241249.334560:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139975424 00000100:00100000:2.0:1782241249.334613:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1782241249.334622:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139975424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.335138:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139975424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 188us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241249.335149:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1782241249.335273:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139975424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.335312:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d46898000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139975552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.335354:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241249.335386:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f8f540 going to sleep for 11 seconds 00000100:00100000:0.0:1782241249.336166:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139975552 00000100:00100000:0.0:1782241249.336174:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139975552 00000100:00100000:0.0:1782241249.336972:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1782241249.336985:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139975552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241249.337262:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139975552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 281us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241249.337269:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1782241249.337949:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d46898000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139975552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782241249.339995:0:13780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f32a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:13780:1868815139975680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241249.340176:0:13780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241249.340945:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139975680 00000100:00100000:2.0:1782241249.340953:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139975680 00000100:00100000:2.0:1782241249.341000:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1782241249.341008:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:13780:x1868815139975680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241249.351345:0:13780:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863240 going to sleep for 11 seconds 00000040:00080000:1.0:1782241249.352645:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782241249.352969:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+23:13780:x1868815139975680:12345-0@lo:502:llog_process_th.0 Request processed in 11955us (12786us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241249.352995:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1782241249.356701:0:13780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f32a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:13780:1868815139975680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782241249.356749:0:13780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241249.357109:0:13780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241249.357113:0:13780:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782241249.357122:0:13780:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890e43609000 00000020:00000080:1.0:1782241249.357125:0:13780:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782241249.357200:0:13780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241249.357204:0:13780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241249.357206:0:13780:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782241249.357209:0:13780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241249.357212:0:13780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241249.357213:0:13780:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1782241249.357217:0:13780:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890e43609000 00000020:00000080:1.0:1782241249.357219:0:13780:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782241249.357273:0:13780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f32a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:13780:1868815139975808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241249.357351:0:13780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241249.357391:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139975808 00000100:00100000:1.0:1782241249.357399:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139975808 00000100:00100000:1.0:1782241249.359456:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1782241249.359472:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+23:13780:x1868815139975808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241249.359617:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+23:13780:x1868815139975808:12345-0@lo:502:llog_process_th.0 Request processed in 149us (2265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241249.359978:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1782241249.360052:0:13780:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863240 going to sleep for 11 seconds 00000100:00100000:1.0:1782241249.360075:0:13780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f32a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:13780:1868815139975808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782241249.360109:0:13780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241249.360117:0:13780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241249.360119:0:13780:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1782241249.360123:0:13780:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1782241249.361197:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1782241249.361227:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782241249.361239:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e199a9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.361250:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e199a9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241249.361262:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782241249.361264:0:6508:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e48138000 from 7 10000000:01000000:2.0:1782241249.361267:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782241249.361305:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.361313:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.361335:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241249.361356:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d46898000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139975936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.361409:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241249.361462:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f8fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241249.362052:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139975936 00000100:00100000:2.0:1782241249.362059:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139975936 00000100:00100000:2.0:1782241249.362120:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1782241249.362131:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+23:6508:x1868815139975936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241249.362144:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241249.362158:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e43facc00/0xc9959f2fb1e199b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e199b0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.362183:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e43facc00/0xc9959f2fb1e199b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e199b0 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.362192:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e43facc00/0xc9959f2fb1e199b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e199b0 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.362200:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43facc00, rc 0) 00000100:00100000:2.0:1782241249.362250:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139975936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241249.362257:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1782241249.362301:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d46898000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139975936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241249.362315:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e199b7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.362331:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e199b7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241249.362390:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d46898000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139976064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.362418:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241249.362436:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f8fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241249.362448:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139976064 00000100:00100000:2.0:1782241249.362450:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139976064 00000100:00100000:2.0:1782241249.362483:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1782241249.362490:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139976064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.362593:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139976064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241249.362600:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1782241249.362625:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d46898000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139976064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.362663:0:6508:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d46898000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139976192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.362698:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241249.362718:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139976192 00000100:00100000:2.0:1782241249.362722:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139976192 00000100:00100000:2.0:1782241249.362738:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1782241249.362744:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6df09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139976192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.363334:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6df09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:6508:x1868815139976192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 587us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241249.363342:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1782241249.363388:0:6508:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f8fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241249.363411:0:6508:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d46898000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:62797b42-772f-434f-be35-dfdfcff291e0:6508:1868815139976192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241249.364426:0:13783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d46898000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:13783:1868815139976320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241249.364550:0:13783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241249.364593:0:13783:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f8f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241249.364993:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139976320 00000100:00100000:0.0:1782241249.365000:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139976320 00000100:00100000:0.0:1782241249.365114:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1782241249.365124:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e49385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:13783:x1868815139976320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241249.365254:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e49385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:13783:x1868815139976320:12345-0@lo:502:llog_process_th.0 Request processed in 132us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241249.365262:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1782241249.365386:0:13783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d46898000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:13783:1868815139976320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782241249.365414:0:13783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241249.365425:0:13783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241249.365427:0:13783:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782241249.365433:0:13783:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890e48138000 00000020:00000080:2.0:1782241249.365436:0:13783:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782241249.365550:0:13783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241249.365555:0:13783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241249.365556:0:13783:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782241249.365559:0:13783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241249.365561:0:13783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241249.365562:0:13783:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1782241249.365566:0:13783:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890e48138000 00000020:00000080:2.0:1782241249.365568:0:13783:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782241249.365610:0:13783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d46898000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:13783:1868815139976448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241249.365662:0:13783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241249.365738:0:13783:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f8f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241249.370115:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139976448 00000100:00100000:0.0:1782241249.370129:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139976448 00000100:00100000:0.0:1782241249.370191:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1782241249.370201:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e438c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:13783:x1868815139976448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241249.370374:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e438c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:13783:x1868815139976448:12345-0@lo:502:llog_process_th.0 Request processed in 174us (4711us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241249.370382:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1782241249.370943:0:13783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d46898000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:62797b42-772f-434f-be35-dfdfcff291e0:13783:1868815139976448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782241249.370979:0:13783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241249.370986:0:13783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241249.370988:0:13783:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1782241249.370992:0:13783:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1782241249.371262:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1782241249.371281:0:6508:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782241249.371298:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e199b7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.371307:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e199b7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782241249.395779:0:13786:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782241249.435002:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241249.435106:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119968640 00000100:00100000:1.0:1782241249.435116:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119968640 00000100:00100000:1.0:1782241249.435168:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 357 00000100:00100000:1.0:1782241249.435178:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e438c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:6169:x1868815119968640:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241249.435197:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241249.435214:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779eac00/0xc9959f2fb1e199be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d3335050ee expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241249.435241:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779eac00/0xc9959f2fb1e199be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050ee expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241249.435251:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779eac00/0xc9959f2fb1e199be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050ee expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241249.435259:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eac00, rc 0) 00000100:00100000:1.0:1782241249.435388:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e438c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:6169:x1868815119968640:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 Request processed in 210us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241249.435396:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 357 00000100:00100000:3.0:1782241249.444968:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241249.445003:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119968768 00000100:00100000:3.0:1782241249.445013:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119968768 00000100:00100000:3.0:1782241249.445062:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 358 00000100:00100000:3.0:1782241249.445072:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e438c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:6169:x1868815119968768:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241249.445844:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e438c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:6169:x1868815119968768:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 Request processed in 769us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241249.445853:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 358 00000100:00100000:3.0:1782241249.450538:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241249.450582:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119968896 00000100:00100000:3.0:1782241249.450594:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119968896 00000100:00100000:3.0:1782241249.450962:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 359 00000100:00100000:3.0:1782241249.450973:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:6169:x1868815119968896:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241249.451127:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:6169:x1868815119968896:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 Request processed in 156us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241249.451136:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 359 00000100:00100000:3.0:1782241249.463865:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241249.463906:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119969024 00000100:00100000:3.0:1782241249.463915:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119969024 00000100:00100000:3.0:1782241249.463964:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 360 00000100:00100000:3.0:1782241249.463974:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:10780:x1868815119969024:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782241249.464124:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:10780:x1868815119969024:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 149us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241249.464141:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 360 00000100:00100000:0.0:1782241249.470878:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241249.471154:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119969152 00000100:00100000:3.0:1782241249.471164:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119969152 00000100:00100000:3.0:1782241249.471284:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 361 00000100:00100000:3.0:1782241249.471295:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:10780:x1868815119969152:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782241249.471431:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:10780:x1868815119969152:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 136us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241249.471439:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 361 00000100:00100000:3.0:1782241249.478790:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241249.480095:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119969280 00000100:00100000:2.0:1782241249.480107:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119969280 00000100:00100000:2.0:1782241249.480155:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 362 00000100:00100000:2.0:1782241249.480165:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:6169:x1868815119969280:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241249.480181:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241249.480200:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e43fada00/0xc9959f2fb1e199c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d3335050f5 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.480227:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e43fada00/0xc9959f2fb1e199c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050f5 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.480239:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e43fada00/0xc9959f2fb1e199c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050f5 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241249.480248:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fada00, rc 0) 00000100:00100000:2.0:1782241249.480312:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:6169:x1868815119969280:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 Request processed in 149us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241249.480319:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 362 00000100:00100000:0.0:1782241249.487307:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241249.487376:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119969408 00000100:00100000:1.0:1782241249.487396:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119969408 00000100:00100000:1.0:1782241249.487450:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 363 00000100:00100000:1.0:1782241249.487462:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:6169:x1868815119969408:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241249.487622:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:6169:x1868815119969408:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 Request processed in 162us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241249.487641:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 363 00000100:00100000:3.0:1782241249.495007:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241249.496539:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119969536 00000100:00100000:0.0:1782241249.496563:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119969536 00000100:00100000:0.0:1782241249.496780:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 364 00000100:00100000:0.0:1782241249.496792:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:6169:x1868815119969536:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241249.497187:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:6169:x1868815119969536:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 Request processed in 394us (2193us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241249.497284:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 364 00000100:00100000:1.0:1782241249.506029:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241249.506460:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119969664 00000100:00100000:3.0:1782241249.506479:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119969664 00000100:00100000:1.0:1782241249.506616:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 365 00000100:00100000:1.0:1782241249.506644:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:10783:x1868815119969664:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782241249.507073:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:10783:x1868815119969664:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 443us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241249.507082:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 365 00000100:00100000:0.0:1782241249.518899:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241249.519070:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119969792 00000100:00100000:3.0:1782241249.519084:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119969792 00000100:00100000:3.0:1782241249.519163:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 366 00000100:00100000:3.0:1782241249.519176:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:10783:x1868815119969792:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782241249.519389:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:10783:x1868815119969792:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 215us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241249.519398:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 366 00000100:00100000:3.0:1782241249.543406:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e778dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139976576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241249.543481:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241249.543547:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139976576 00000100:00100000:2.0:1782241249.543556:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139976576 00000100:00100000:2.0:1782241249.543611:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1782241249.543622:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139976576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782241249.543692:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782241249.543810:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139976576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 189us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241249.543818:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1782241249.543881:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e778dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139976576:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782241249.925549:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782241250.373456:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1782241250.438494:0:13786:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1782241250.565127:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d46898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139977088:0@lo:400:kworker.0 00000100:00100000:2.0:1782241250.565203:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241250.565257:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d46898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139976704:0@lo:400:kworker.0 00000100:00100000:2.0:1782241250.565283:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d46898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139977600:0@lo:400:kworker.0 00000100:00100000:0.0:1782241250.565305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241250.565317:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241250.565392:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d46899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139976960:0@lo:400:kworker.0 00000100:00100000:3.0:1782241250.565622:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d46899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139976832:0@lo:400:kworker.0 00000100:00100000:0.0:1782241250.568679:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4689aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139977216:0@lo:400:kworker.0 00000100:00100000:0.0:1782241250.568850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241250.568903:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139977728:0@lo:400:kworker.0 00000100:00100000:0.0:1782241250.568931:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241250.569094:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139978240:0@lo:400:kworker.0 00000100:00100000:0.0:1782241250.569134:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241250.569530:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139977216 00000100:00100000:2.0:1782241250.569540:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139977216 00000100:00100000:2.0:1782241250.569593:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1782241250.569615:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139977216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241250.569681:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139977216:12345-0@lo:400:kworker.0 Request processed in 79us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241250.569689:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1782241250.570264:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139977088 00000100:00100000:2.0:1782241250.570272:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139977088 00000100:00100000:2.0:1782241250.570308:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1782241250.570315:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139977088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241250.570359:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139977088:12345-0@lo:400:kworker.0 Request processed in 45us (5157us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241250.570365:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1782241250.570392:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139978112:0@lo:400:kworker.0 00000100:00100000:2.0:1782241250.570423:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241250.570461:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139977600 00000100:00100000:2.0:1782241250.570465:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139977600 00000100:00100000:2.0:1782241250.570493:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139977728 00000100:00100000:2.0:1782241250.570496:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139977728 00000100:00100000:2.0:1782241250.570507:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139978240 00000100:00100000:2.0:1782241250.570509:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139978240 00000100:00100000:2.0:1782241250.570518:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139978112 00000100:00100000:2.0:1782241250.570520:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139978112 00000100:00100000:2.0:1782241250.570530:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782241250.570536:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139977600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241250.570568:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139977600:12345-0@lo:400:kworker.0 Request processed in 32us (5251us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241250.570574:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782241250.570584:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782241250.570589:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139977728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241250.570630:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139977728:12345-0@lo:400:kworker.0 Request processed in 41us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241250.570636:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782241250.570645:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782241250.570651:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815139978240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241250.570676:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815139978240:12345-0@lo:400:kworker.0 Request processed in 25us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241250.570682:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782241250.570692:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782241250.572261:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4689aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139977216:0@lo:400:kworker.0 00010000:00080000:0.0:1782241250.572280:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f643800 x1868815139977728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241250.572291:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139977728:0@lo:400:kworker.0 00000100:00100000:0.0:1782241250.572303:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139978240:0@lo:400:kworker.0 00000100:00100000:0.0:1782241250.572537:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241250.572547:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4689aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139978368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241250.572592:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241250.572657:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139978368 00000100:00100000:0.0:1782241250.572664:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139978368 00000100:00100000:2.0:1782241250.572910:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139978112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241250.572992:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139978112:12345-0@lo:400:kworker.0 Request processed in 2293us (2566us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241250.573016:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1782241250.573195:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782241250.573201:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241250.573240:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139978112:0@lo:400:kworker.0 00000100:00100000:2.0:1782241250.573263:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d46898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139977088:0@lo:400:kworker.0 00010000:00080000:2.0:1782241250.573277:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d46898380 x1868815139977600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241250.573287:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d46898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139977600:0@lo:400:kworker.0 00000100:00100000:1.0:1782241250.573633:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241250.573666:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4689a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139977472:0@lo:400:kworker.0 00000100:00100000:1.0:1782241250.573695:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241250.573728:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815139977984:0@lo:400:kworker.0 00000100:00100000:1.0:1782241250.573751:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241250.573792:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139976704 00000100:00100000:1.0:1782241250.573797:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139976704 00000100:00100000:0.0:1782241250.575689:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782241250.575709:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815139978368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782241250.575744:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241250.575852:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815139978368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (3259us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241250.575860:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782241250.575921:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4689aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139978368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241250.578940:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139976960 00000100:00100000:2.0:1782241250.578955:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139976960 00000100:00100000:2.0:1782241250.579017:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1782241250.579027:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139976960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241250.579147:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139976960:12345-0@lo:400:kworker.0 Request processed in 121us (5513us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241250.579155:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1782241250.579181:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139977472 00000100:00100000:2.0:1782241250.579185:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139977472 00000100:00100000:2.0:1782241250.579218:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139977984 00000100:00100000:2.0:1782241250.579221:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139977984 00000100:00100000:2.0:1782241250.579243:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1782241250.579249:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139977472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241250.579287:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139977472:12345-0@lo:400:kworker.0 Request processed in 38us (5590us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241250.579294:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1782241250.579306:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1782241250.579327:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815139977984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241250.579362:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815139977984:12345-0@lo:400:kworker.0 Request processed in 37us (5610us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241250.579368:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:2.0:1782241250.579388:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782241250.580866:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1782241250.580887:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139976704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241250.580956:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139976704:12345-0@lo:400:kworker.0 Request processed in 78us (15651us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241250.580975:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1782241250.581046:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d46899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139976960:0@lo:400:kworker.0 00010000:00080000:1.0:1782241250.581068:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4689a300 x1868815139977472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241250.581080:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4689a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139977472:0@lo:400:kworker.0 00010000:00080000:1.0:1782241250.581093:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f640a80 x1868815139977984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241250.581103:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815139977984:0@lo:400:kworker.0 00000100:00100000:3.0:1782241250.581320:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241250.581364:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4689bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815139977344:0@lo:400:kworker.0 00000100:00100000:3.0:1782241250.581404:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241250.581433:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815139977856:0@lo:400:kworker.0 00000100:00100000:3.0:1782241250.581454:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241250.581477:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139976832 00000100:00100000:3.0:1782241250.581483:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139976832 00000100:00100000:3.0:1782241250.581515:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139977344 00000100:00100000:3.0:1782241250.581518:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139977344 00000100:00100000:3.0:1782241250.581541:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139977856 00000100:00100000:3.0:1782241250.581544:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139977856 00000100:00100000:3.0:1782241250.581558:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1782241250.581565:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139976832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241250.581596:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139976832:12345-0@lo:400:kworker.0 Request processed in 32us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241250.581602:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1782241250.581628:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1782241250.581634:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815139977344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241250.581660:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815139977344:12345-0@lo:400:kworker.0 Request processed in 27us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241250.581666:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1782241250.581678:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1782241250.581683:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815139977856:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782241250.581819:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241250.581927:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d46898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139976704:0@lo:400:kworker.0 00000100:00100000:2.0:1782241250.581967:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d46899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139976832:0@lo:400:kworker.0 00000100:00100000:2.0:1782241250.581977:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4689bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815139977344:0@lo:400:kworker.0 00000100:00100000:3.0:1782241250.582265:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815139977856:12345-0@lo:400:kworker.0 Request processed in 580us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241250.582273:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1782241250.588322:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815139977856:0@lo:400:kworker.0 00010000:00010000:0.0:1782241250.951480:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241251.077069:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139978496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241251.077143:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241251.080014:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139978496 00000100:00100000:0.0:1782241251.080029:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139978496 00000100:00100000:0.0:1782241251.080098:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782241251.080109:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139978496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241251.080138:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241251.080285:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139978624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241251.084784:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241251.084864:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139978624 00000100:00100000:2.0:1782241251.084873:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139978624 00000100:00100000:2.0:1782241251.084928:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1782241251.085650:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139978624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782241251.085706:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782241251.085816:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139978624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 879us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241251.085824:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1782241251.085917:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139978624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241251.085940:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139978496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5829us (8793us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241251.085950:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782241251.087824:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139978496:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1782241251.978144:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241252.613329:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241252.613366:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139978752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241252.613436:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241252.614794:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139978752 00000100:00100000:0.0:1782241252.614805:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139978752 00000100:00100000:0.0:1782241252.614870:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782241252.614879:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139978752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782241252.614907:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241252.614982:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139978752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241252.614988:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1782241252.615091:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139978880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241252.615122:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1782241252.615163:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e43f32680 x1868815139978752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241252.615182:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139978752:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782241252.615258:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241252.615298:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139978880 00000100:00100000:1.0:1782241252.615302:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139978880 00000100:00100000:1.0:1782241252.615333:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782241252.615339:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139978880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782241252.615349:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241252.615383:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139978880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241252.615388:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1782241252.615442:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4803b800 x1868815139978880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241252.615453:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139978880:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1782241252.615498:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782241252.997981:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782241253.639892:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1782241253.786536:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241253.786612:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241253.786643:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119969920 00000100:00100000:3.0:1782241253.786665:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241253.786666:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119969920 00000100:00100000:3.0:1782241253.786713:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241253.786820:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241253.786831:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 368 00000100:00100000:0.0:1782241253.786848:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2399:x1868815119969920:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241253.786883:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119970304 00000100:00100000:3.0:1782241253.786893:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119970304 00000100:00100000:0.0:1782241253.786942:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2399:x1868815119969920:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 98us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241253.786952:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 368 00000100:00100000:3.0:1782241253.786970:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 89 00000100:00100000:3.0:1782241253.786987:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119970304:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241253.787051:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119970304:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 68us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241253.787059:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 89 00000100:00080000:3.0:1782241253.787088:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782241253.787280:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119970176 00000100:00100000:1.0:1782241253.787287:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119970176 00000100:00100000:1.0:1782241253.787341:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119970432 00000100:00100000:1.0:1782241253.787344:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119970432 00000100:00100000:1.0:1782241253.787363:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119970048 00000100:00100000:1.0:1782241253.787366:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119970048 00000100:00100000:1.0:1782241253.787386:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 216 00000100:00100000:1.0:1782241253.787408:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119970176:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241253.787453:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119970176:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 47us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241253.787460:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 216 00000100:00100000:1.0:1782241253.787477:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 217 00000100:00100000:1.0:1782241253.787484:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119970432:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241253.787507:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119970432:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 24us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241253.787513:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 217 00000100:00100000:1.0:1782241253.787524:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 218 00000100:00100000:1.0:1782241253.787530:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119970048:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241253.787564:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119970048:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 34us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241253.787569:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 218 00000100:00080000:3.0:1782241253.789115:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782241253.789126:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782241253.789528:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241253.789707:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119970560 00000100:00100000:1.0:1782241253.789720:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119970560 00000100:00080000:3.0:1782241253.789796:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782241253.789834:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 219 00000100:00100000:1.0:1782241253.789846:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119970560:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241253.789917:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815119970560:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 73us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241253.789924:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 219 00010000:00010000:3.0:1782241254.021106:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241254.661478:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241254.661502:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139979008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782241254.661588:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241254.661737:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139979008 00000100:00100000:3.0:1782241254.661744:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139979008 00000100:00100000:3.0:1782241254.661814:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1782241254.661824:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139979008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782241254.661863:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782241254.661927:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139979008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241254.661935:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1782241254.661997:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139979008:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782241255.045085:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241255.685383:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139979136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241255.685485:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241255.685579:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139979136 00000100:00100000:1.0:1782241255.685590:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139979136 00000100:00100000:1.0:1782241255.685672:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782241255.685688:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139979136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782241255.685750:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241255.685824:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139979264:0@lo:400:kworker.0 00000100:00100000:0.0:1782241255.685872:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241255.693733:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241255.693782:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139979520:0@lo:400:kworker.0 00000100:00100000:2.0:1782241255.694047:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241255.694120:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139980032:0@lo:400:kworker.0 00000100:00100000:2.0:1782241255.694128:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139979648:0@lo:400:kworker.0 00000100:00100000:3.0:1782241255.694158:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241255.694212:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139980032 00000100:00100000:3.0:1782241255.694221:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139980032 00000100:00100000:2.0:1782241255.694283:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241255.694310:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139980160:0@lo:400:kworker.0 00000100:00100000:2.0:1782241255.694470:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241255.694496:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139980672:0@lo:400:kworker.0 00000100:00100000:2.0:1782241255.694531:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241255.694571:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139979520 00000100:00100000:2.0:1782241255.694575:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139979520 00000100:00100000:2.0:1782241255.694613:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1782241255.694623:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139979520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241255.694689:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139979520:12345-0@lo:400:kworker.0 Request processed in 65us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241255.694697:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1782241255.694724:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139980160 00000100:00100000:2.0:1782241255.694728:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139980160 00000100:00100000:2.0:1782241255.694753:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139980672 00000100:00100000:2.0:1782241255.694777:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139980672 00000100:00100000:2.0:1782241255.694800:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782241255.694806:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139980160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241255.694851:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139980160:12345-0@lo:400:kworker.0 Request processed in 44us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241255.694857:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782241255.694869:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782241255.694875:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139980672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241255.695116:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139980672:12345-0@lo:400:kworker.0 Request processed in 240us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241255.695124:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1782241255.695252:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77b44700 x1868815139980160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241255.695269:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139980160:0@lo:400:kworker.0 00000100:00100000:2.0:1782241255.695283:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139980672:0@lo:400:kworker.0 00000100:00100000:2.0:1782241255.695293:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139979520:0@lo:400:kworker.0 00000100:00100000:1.0:1782241255.696060:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139979136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10374us (10571us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241255.696073:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782241255.696131:0:3638:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1782241255.696138:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff890d4789e680, transno 4294967301 00000100:00100000:1.0:1782241255.696174:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139979136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241255.701999:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139979648 00000100:00100000:3.0:1782241255.702023:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139979648 00000100:00100000:2.0:1782241255.702094:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1782241255.702109:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1782241255.702116:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139980032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241255.702122:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139979648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241255.704114:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139979776:0@lo:400:kworker.0 00000100:00080000:1.0:1782241255.704799:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782241255.704939:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241255.704945:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782241255.704968:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139979264 00000100:00100000:1.0:1782241255.704977:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139979264 00000100:00100000:1.0:1782241255.705066:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1782241255.705077:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139979264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241255.705277:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139980032:12345-0@lo:400:kworker.0 Request processed in 3167us (11115us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241255.705289:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1782241255.705363:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815139979264:12345-0@lo:400:kworker.0 Request processed in 286us (19488us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241255.705373:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1782241255.705425:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241255.705498:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139979776 00000100:00100000:1.0:1782241255.705516:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139979776 00000100:00100000:0.0:1782241255.705519:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139980288:0@lo:400:kworker.0 00000100:00100000:1.0:1782241255.705552:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1782241255.705561:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139979776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241255.705576:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241255.705618:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139979776:12345-0@lo:400:kworker.0 Request processed in 58us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241255.705625:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1782241255.705630:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815139979264:0@lo:400:kworker.0 00000100:00100000:1.0:1782241255.705661:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139980288 00000100:00100000:1.0:1782241255.705666:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139980288 00000100:00100000:0.0:1782241255.705671:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139979776:0@lo:400:kworker.0 00000100:00100000:1.0:1782241255.705707:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782241255.705727:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139980288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241255.706680:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00010000:00080000:2.0:1782241255.706920:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77b47100 x1868815139980032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241255.706937:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139980032:0@lo:400:kworker.0 00000100:00100000:2.0:1782241255.706950:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815139980544:0@lo:400:kworker.0 00000100:00100000:2.0:1782241255.707009:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241255.707113:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139980544 00000100:00100000:2.0:1782241255.707120:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139980544 00000100:00100000:2.0:1782241255.707171:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1782241255.707193:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815139980544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241255.707244:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815139980544:12345-0@lo:400:kworker.0 Request processed in 52us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241255.707252:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00010000:00080000:2.0:1782241255.707288:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77b45180 x1868815139980544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241255.707298:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815139980544:0@lo:400:kworker.0 00000100:00100000:1.0:1782241255.707624:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139980288:12345-0@lo:400:kworker.0 Request processed in 1897us (2046us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241255.707634:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1782241255.707659:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241255.707664:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241255.710602:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815139979392:0@lo:400:kworker.0 00000100:00100000:0.0:1782241255.711092:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241255.711266:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139979648:12345-0@lo:400:kworker.0 Request processed in 9144us (16977us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241255.711285:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1782241255.711406:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139979648:0@lo:400:kworker.0 00000100:00100000:0.0:1782241255.711413:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815139979904:0@lo:400:kworker.0 00000100:00100000:0.0:1782241255.711454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241255.712449:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139979392 00000100:00100000:3.0:1782241255.712463:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139979392 00000100:00100000:3.0:1782241255.712540:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1782241255.712552:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815139979392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241255.712647:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815139979392:12345-0@lo:400:kworker.0 Request processed in 96us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241255.712674:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1782241255.716242:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815139980416:0@lo:400:kworker.0 00000100:00100000:0.0:1782241255.716334:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1782241255.716575:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77b47480 x1868815139980288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241255.716592:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139980288:0@lo:400:kworker.0 00000100:00100000:0.0:1782241255.716631:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815139979392:0@lo:400:kworker.0 00000100:00100000:1.0:1782241255.716952:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139979904 00000100:00100000:1.0:1782241255.716961:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139979904 00000100:00100000:0.0:1782241255.720085:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139980416 00000100:00100000:0.0:1782241255.720103:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139980416 00000100:00100000:0.0:1782241255.720142:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1782241255.720154:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815139979904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241255.720420:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815139979904:12345-0@lo:400:kworker.0 Request processed in 266us (8964us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241255.720429:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1782241255.720453:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1782241255.720460:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815139980416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241255.720530:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815139980416:12345-0@lo:400:kworker.0 Request processed in 70us (4197us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241255.720536:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1782241255.720599:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815139979904:0@lo:400:kworker.0 00000100:00100000:0.0:1782241255.720611:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815139980416:0@lo:400:kworker.0 00000100:00080000:1.0:1782241255.727373:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782241256.069172:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241256.198789:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139980800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241256.199029:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241256.199388:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139980928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241256.199440:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241256.199569:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139980928 00000100:00100000:1.0:1782241256.199580:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139980928 00000100:00100000:1.0:1782241256.199704:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782241256.199716:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139980928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241256.199788:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241256.199850:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139980928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241256.199858:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1782241256.199952:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139980928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241256.206017:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139980800 00000100:00100000:2.0:1782241256.206039:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139980800 00000100:00100000:2.0:1782241256.206123:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782241256.206139:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139980800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782241256.206190:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241256.212746:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139980800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6584us (13689us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241256.212782:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782241256.218423:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139980800:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1782241257.093082:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241257.733077:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139981056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782241257.733386:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241257.733524:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241257.733532:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139981184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782241257.733563:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241257.733607:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139981056 00000100:00100000:2.0:1782241257.733615:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139981056 00000100:00100000:2.0:1782241257.733735:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139981184 00000100:00100000:2.0:1782241257.733754:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139981184 00000100:00100000:2.0:1782241257.733808:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782241257.733816:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139981056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782241257.733854:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241257.734136:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139981056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 318us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241257.734143:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782241257.734162:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782241257.734168:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139981184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782241257.734178:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241257.734411:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139981184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 242us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241257.734417:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:2.0:1782241257.734460:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e43f30e00 x1868815139981184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241257.734496:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139981184:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1782241257.734508:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d661c00 x1868815139981056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241257.734519:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139981056:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1782241257.734774:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782241258.119547:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241258.907509:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241258.907567:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241258.907592:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241258.907699:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241258.907801:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119970688 00000100:00100000:2.0:1782241258.907814:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119970688 00000100:00100000:2.0:1782241258.907888:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 370 00000100:00100000:2.0:1782241258.907901:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2397:x1868815119970688:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241258.908003:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2397:x1868815119970688:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 104us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241258.908031:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 370 00000100:00100000:1.0:1782241258.916991:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241258.917035:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241258.919621:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119970944 00000100:00100000:3.0:1782241258.919644:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119970944 00000100:00100000:3.0:1782241258.919735:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119971072 00000100:00100000:3.0:1782241258.919740:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119971072 00000100:00100000:3.0:1782241258.919872:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 93 00000100:00100000:3.0:1782241258.919886:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815119971072:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241258.920002:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815119971072:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 120us (3027us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241258.920012:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 93 00000100:00100000:3.0:1782241258.920084:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119971200 00000100:00100000:3.0:1782241258.920089:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119971200 00000100:00100000:3.0:1782241258.920111:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119970816 00000100:00100000:3.0:1782241258.920114:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119970816 00000100:00100000:3.0:1782241258.920133:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 226 00000100:00100000:3.0:1782241258.920139:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815119970944:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241258.920175:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815119970944:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 34us (12606us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241258.920182:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 226 00000100:00100000:3.0:1782241258.920195:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 227 00000100:00100000:3.0:1782241258.920202:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2397:x1868815119971200:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241258.922451:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2397:x1868815119971200:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 2223us (14832us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241258.922471:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 227 00000100:00100000:3.0:1782241258.922514:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 228 00000100:00100000:3.0:1782241258.922722:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815119970816:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241258.924815:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119971328 00000100:00100000:2.0:1782241258.924837:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119971328 00000100:00100000:2.0:1782241258.924935:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 229 00000100:00100000:2.0:1782241258.924947:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2397:x1868815119971328:12345-192.168.204.58@tcp:400:kworker.0 00000100:00080000:0.0:1782241258.928592:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241258.928606:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241258.928610:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782241258.929721:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815119970816:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 6993us (22007us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241258.929739:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 228 00000100:00100000:2.0:1782241258.929872:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2397:x1868815119971328:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 4924us (12832us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241258.929883:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 229 00010000:00010000:0.0:1782241259.142404:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241259.781173:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139981312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241259.781276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241259.781467:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139981312 00000100:00100000:3.0:1782241259.781477:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139981312 00000100:00100000:3.0:1782241259.781539:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1782241259.781550:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139981312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782241259.781597:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782241259.781655:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139981312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241259.781665:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1782241259.781888:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139981312:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782241260.167811:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782241260.614714:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1782241260.679262:0:13786:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782241260.805421:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139981440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241260.805532:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241260.805930:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139981440 00000100:00100000:0.0:1782241260.805942:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139981440 00000100:00100000:0.0:1782241260.806026:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782241260.806040:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139981440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782241260.806093:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241260.806196:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139981440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241260.806204:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1782241260.806464:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782241260.806633:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139981440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782241260.806966:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139981696:0@lo:400:kworker.0 00000100:00100000:1.0:1782241260.807021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241260.807066:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139982208:0@lo:400:kworker.0 00000100:00100000:1.0:1782241260.807092:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241260.807117:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139982720:0@lo:400:kworker.0 00000100:00100000:1.0:1782241260.807370:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241260.807398:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1782241260.807417:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139981568:0@lo:400:kworker.0 00000100:00100000:1.0:1782241260.807452:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241260.807478:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139982080:0@lo:400:kworker.0 00000100:00100000:1.0:1782241260.807505:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241260.807522:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139982592:0@lo:400:kworker.0 00000100:00100000:1.0:1782241260.807547:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241260.807578:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139981568 00000100:00100000:3.0:1782241260.807693:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139981824:0@lo:400:kworker.0 00000100:00100000:3.0:1782241260.807728:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241260.807750:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139982336:0@lo:400:kworker.0 00000100:00100000:3.0:1782241260.807804:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241260.807821:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815139982848:0@lo:400:kworker.0 00000100:00100000:3.0:1782241260.807862:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241260.807882:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782241260.807888:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139981952:0@lo:400:kworker.0 00000100:00100000:3.0:1782241260.807911:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241260.807923:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139982464:0@lo:400:kworker.0 00000100:00100000:3.0:1782241260.807945:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241260.807959:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139982976:0@lo:400:kworker.0 00000100:00100000:3.0:1782241260.807978:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241260.808010:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139982080 00000100:00100000:3.0:1782241260.808015:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139982080 00000100:00100000:3.0:1782241260.808069:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139981824 00000100:00100000:3.0:1782241260.808072:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139981824 00000100:00100000:3.0:1782241260.808090:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1782241260.808099:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139982080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241260.808169:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139982080:12345-0@lo:400:kworker.0 Request processed in 70us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241260.808177:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782241260.808342:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139981696 00000100:00100000:2.0:1782241260.808348:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139981696 00000100:00100000:2.0:1782241260.808375:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139982208 00000100:00100000:2.0:1782241260.808378:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139982208 00000100:00100000:2.0:1782241260.808401:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139982720 00000100:00100000:2.0:1782241260.808415:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139982720 00000100:00100000:2.0:1782241260.808432:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139982336 00000100:00100000:2.0:1782241260.808434:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139982336 00000100:00100000:2.0:1782241260.808449:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139982848 00000100:00100000:2.0:1782241260.808452:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139982848 00000100:00100000:2.0:1782241260.808466:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139981952 00000100:00100000:2.0:1782241260.808469:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139981952 00000100:00100000:2.0:1782241260.809770:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1782241260.809819:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139982592 00000100:00100000:2.0:1782241260.809826:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139982592 00000100:00100000:2.0:1782241260.809884:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139982464 00000100:00100000:2.0:1782241260.809888:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139982464 00000100:00100000:2.0:1782241260.809908:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139982976 00000100:00100000:2.0:1782241260.809911:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139982976 00000100:00100000:2.0:1782241260.809930:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782241260.809938:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139982592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241260.810055:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139982592:12345-0@lo:400:kworker.0 Request processed in 118us (2505us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241260.810064:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782241260.810083:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782241260.810090:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139982464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241260.810131:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139982464:12345-0@lo:400:kworker.0 Request processed in 42us (2185us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241260.810138:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782241260.810149:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1782241260.810155:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139982976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241260.810185:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139982976:12345-0@lo:400:kworker.0 Request processed in 30us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241260.810191:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1782241260.810213:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1782241260.810221:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139982208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241260.810258:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139982208:12345-0@lo:400:kworker.0 Request processed in 38us (3165us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241260.810265:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1782241260.810279:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1782241260.810287:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139982720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241260.810317:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139982720:12345-0@lo:400:kworker.0 Request processed in 32us (2948us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241260.810323:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1782241260.810334:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1782241260.810340:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139982336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241260.810382:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139982336:12345-0@lo:400:kworker.0 Request processed in 42us (2577us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241260.810388:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1782241260.810400:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1782241260.810419:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815139982848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241260.810454:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815139982848:12345-0@lo:400:kworker.0 Request processed in 48us (2591us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241260.810460:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1782241260.810471:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1782241260.810477:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139981952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241260.810507:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139981952:12345-0@lo:400:kworker.0 Request processed in 30us (2595us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241260.810513:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:2.0:1782241260.810537:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782241260.810542:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782241260.810545:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241260.810547:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241260.810558:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139981696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241260.810606:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139981696:12345-0@lo:400:kworker.0 Request processed in 824us (3586us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241260.810613:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1782241260.810665:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139981952:0@lo:400:kworker.0 00010000:00080000:2.0:1782241260.810683:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77b44e00 x1868815139982464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241260.810695:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139982464:0@lo:400:kworker.0 00000100:00100000:2.0:1782241260.810718:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139982976:0@lo:400:kworker.0 00010000:00080000:2.0:1782241260.810729:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f643800 x1868815139982336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241260.810737:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139982336:0@lo:400:kworker.0 00010000:00080000:2.0:1782241260.810748:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77b44a80 x1868815139982848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241260.810782:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815139982848:0@lo:400:kworker.0 00000100:00100000:2.0:1782241260.810884:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139982080:0@lo:400:kworker.0 00010000:00080000:2.0:1782241260.810897:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e77b44000 x1868815139982592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241260.810907:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139982592:0@lo:400:kworker.0 00000100:00100000:2.0:1782241260.810919:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139981696:0@lo:400:kworker.0 00000100:00100000:2.0:1782241260.810931:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139982208:0@lo:400:kworker.0 00000100:00100000:2.0:1782241260.810945:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139982720:0@lo:400:kworker.0 00000100:00100000:1.0:1782241260.811057:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139981568 00000100:00100000:1.0:1782241260.811093:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1782241260.811105:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139981824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241260.811163:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139981824:12345-0@lo:400:kworker.0 Request processed in 61us (3434us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241260.811169:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1782241260.811222:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1782241260.811229:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815139981568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241260.811268:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815139981568:12345-0@lo:400:kworker.0 Request processed in 39us (3815us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241260.811275:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1782241260.811329:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139981568:0@lo:400:kworker.0 00000100:00100000:2.0:1782241260.813423:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139981824:0@lo:400:kworker.0 00010000:00010000:2.0:1782241261.190889:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241261.317508:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139983104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241261.317638:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241261.317802:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139983104 00000100:00100000:1.0:1782241261.317812:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139983104 00000100:00100000:1.0:1782241261.317971:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782241261.317985:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139983104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782241261.318028:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241261.318097:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139983104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241261.318114:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782241261.318357:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139983104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241261.318587:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139983232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241261.318634:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241261.320357:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139983232 00000100:00100000:0.0:1782241261.320375:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139983232 00000100:00100000:0.0:1782241261.320470:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1782241261.320482:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139983232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241261.320532:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782241261.320681:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139983232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 201us (2045us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241261.320688:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1782241261.320787:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139983232:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782241262.223810:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241262.853134:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139983360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782241262.853206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241262.853289:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782241262.853310:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139983488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782241262.853334:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241262.853429:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139983360 00000100:00100000:3.0:1782241262.853437:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139983360 00000100:00100000:3.0:1782241262.853488:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139983488 00000100:00100000:3.0:1782241262.853491:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139983488 00000100:00100000:3.0:1782241262.853508:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782241262.853517:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139983360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782241262.853561:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241262.853613:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139983360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241262.853629:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782241262.853647:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782241262.853654:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139983488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782241262.853664:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241262.853689:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139983488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241262.853694:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:3.0:1782241262.853726:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4793c380 x1868815139983488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241262.853743:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139983488:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1782241262.853778:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d661180 x1868815139983360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241262.853791:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139983360:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1782241262.853967:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782241263.238729:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241264.035047:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241264.035112:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241264.035226:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241264.035399:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119971712 00000100:00100000:3.0:1782241264.035410:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119971712 00000100:00100000:3.0:1782241264.035480:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119971584 00000100:00100000:3.0:1782241264.035484:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119971584 00000100:00100000:3.0:1782241264.035507:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 236 00000100:00100000:3.0:1782241264.035516:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119971712:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241264.035587:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119971712:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 71us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241264.035595:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 236 00000100:00100000:3.0:1782241264.035612:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 237 00000100:00100000:3.0:1782241264.035618:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119971584:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241264.035658:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119971584:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 40us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241264.035666:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 237 00000100:00100000:2.0:1782241264.035748:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119971456 00000100:00100000:2.0:1782241264.035794:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119971456 00000100:00100000:2.0:1782241264.035834:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 372 00000100:00100000:2.0:1782241264.035845:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2399:x1868815119971456:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241264.035879:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2399:x1868815119971456:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 38us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241264.035885:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 372 00000100:00080000:0.0:1782241264.036413:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241264.036418:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782241264.048862:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241264.048974:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119971840 00000100:00100000:2.0:1782241264.048984:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119971840 00000100:00100000:2.0:1782241264.049069:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 27 00000100:00100000:2.0:1782241264.049095:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2395:x1868815119971840:12345-192.168.204.58@tcp:9:kworker.0 00000020:00000080:2.0:1782241264.049130:0:8746:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e198ec 00000100:00080000:2.0:1782241264.049139:0:8746:0:(import.c:65:import_set_state_nolock()) ffff890d47b79000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782241264.049190:0:8746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1782241264.049356:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+2:2395:x1868815119971840:12345-192.168.204.58@tcp:9:kworker.0 Request processed in 252us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241264.049364:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 27 00010000:00010000:1.0:1782241264.049439:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782241264.049481:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782241264.049926:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241264.049958:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241264.050031:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119971968 00000100:00100000:0.0:1782241264.050036:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119971968 00000100:00100000:0.0:1782241264.050102:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119972096 00000100:00100000:0.0:1782241264.050106:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119972096 00000100:00100000:0.0:1782241264.050128:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 238 00000100:00100000:0.0:1782241264.050136:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119971968:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241264.050181:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119971968:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 45us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241264.050188:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 238 00000100:00100000:0.0:1782241264.050203:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 239 00000100:00100000:0.0:1782241264.050209:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119972096:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241264.050234:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119972096:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 24us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241264.050255:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 239 00000100:00080000:2.0:1782241264.050678:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241264.050682:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782241264.262605:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241264.901094:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139983616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241264.901201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241264.901347:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139983616 00000100:00100000:3.0:1782241264.901356:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139983616 00000100:00100000:3.0:1782241264.901411:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1782241264.901420:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139983616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782241264.901456:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782241264.901517:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139983616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241264.901524:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782241264.901676:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139983616:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782241265.285783:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241265.924995:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241265.925018:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139983744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241265.925094:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241265.925158:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139984128:0@lo:400:kworker.0 00000100:00100000:3.0:1782241265.925195:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241265.925210:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f59a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139984640:0@lo:400:kworker.0 00000100:00100000:0.0:1782241265.925211:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139984000:0@lo:400:kworker.0 00000100:00100000:0.0:1782241265.925238:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241265.925255:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139983744 00000100:00100000:3.0:1782241265.925264:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139983744 00000100:00100000:0.0:1782241265.925289:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815139984512:0@lo:400:kworker.0 00000100:00100000:0.0:1782241265.925324:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241265.925332:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782241265.925342:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f59b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815139985024:0@lo:400:kworker.0 00000100:00100000:3.0:1782241265.925343:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139983744:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241265.925362:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1782241265.925381:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241265.925386:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1782241265.925391:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139983872:0@lo:400:kworker.0 00000100:00080000:2.0:1782241265.925454:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782241265.925481:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139984000 00000100:00100000:2.0:1782241265.925486:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139984000 00000100:00100000:3.0:1782241265.925505:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139983744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241265.925513:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139984512 00000100:00100000:2.0:1782241265.925515:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139984512 00000100:00100000:3.0:1782241265.925522:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782241265.925541:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139985024 00000100:00100000:2.0:1782241265.925544:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139985024 00000100:00100000:2.0:1782241265.925559:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00080000:3.0:1782241265.925561:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241265.925565:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139984000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241265.925574:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1782241265.925580:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815139984512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241265.925662:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139984256:0@lo:400:kworker.0 00000100:00100000:0.0:1782241265.926015:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241265.927203:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815139984512:12345-0@lo:400:kworker.0 Request processed in 1617us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241265.927216:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1782241265.927246:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1782241265.927257:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f59ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815139985024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241265.927315:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f59ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815139985024:12345-0@lo:400:kworker.0 Request processed in 50us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241265.927322:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1782241265.927374:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139984128 00000100:00100000:3.0:1782241265.927382:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139984128 00000100:00100000:3.0:1782241265.927413:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1782241265.927419:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139984128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241265.927453:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139984128:12345-0@lo:400:kworker.0 Request processed in 34us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241265.927459:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1782241265.927505:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241265.927569:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139983744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241265.927595:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f59b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815139985152:0@lo:400:kworker.0 00000100:00100000:3.0:1782241265.927624:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241265.927645:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139984128:0@lo:400:kworker.0 00000100:00100000:3.0:1782241265.927682:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139984640 00000100:00100000:3.0:1782241265.927685:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139984640 00000100:00100000:3.0:1782241265.927709:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139985152 00000100:00100000:3.0:1782241265.927712:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139985152 00000100:00100000:3.0:1782241265.927728:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1782241265.927733:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139984640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241265.927786:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139984640:12345-0@lo:400:kworker.0 Request processed in 52us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241265.927792:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1782241265.927803:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1782241265.927808:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815139985152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241265.927845:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815139985152:12345-0@lo:400:kworker.0 Request processed in 38us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241265.927851:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1782241265.927870:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1782241265.927891:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f59b800 x1868815139985152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241265.927901:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f59b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815139985152:0@lo:400:kworker.0 00010000:00080000:3.0:1782241265.927911:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f59a300 x1868815139984640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241265.927920:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f59a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139984640:0@lo:400:kworker.0 00000100:00100000:3.0:1782241265.927963:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139983872 00000100:00100000:3.0:1782241265.927967:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139983872 00000100:00100000:3.0:1782241265.927995:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1782241265.928002:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139983872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241265.928042:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139983872:12345-0@lo:400:kworker.0 Request processed in 41us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241265.928048:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1782241265.930640:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139984000:12345-0@lo:400:kworker.0 Request processed in 5063us (5389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241265.930655:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1782241265.930821:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241265.930871:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139984768:0@lo:400:kworker.0 00000100:00100000:1.0:1782241265.930911:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241265.930945:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139985280:0@lo:400:kworker.0 00000100:00100000:1.0:1782241265.930968:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241265.931087:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139984768 00000100:00100000:2.0:1782241265.931094:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139984768 00000100:00100000:2.0:1782241265.931138:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139985280 00000100:00100000:2.0:1782241265.931141:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139985280 00000100:00100000:2.0:1782241265.931163:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782241265.931171:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d995f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139984768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241265.931225:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d995f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139984768:12345-0@lo:400:kworker.0 Request processed in 55us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241265.931232:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782241265.931243:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782241265.931249:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139985280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241265.931277:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139985280:12345-0@lo:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241265.931283:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1782241265.931359:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241265.931364:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782241265.931391:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f598380 x1868815139984768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241265.931405:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139984768:0@lo:400:kworker.0 00000100:00100000:1.0:1782241265.931417:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139985280:0@lo:400:kworker.0 00000100:00100000:3.0:1782241265.931495:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139984256 00000100:00100000:3.0:1782241265.931500:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139984256 00000100:00100000:3.0:1782241265.931543:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1782241265.931551:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139984256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241265.931598:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139984256:12345-0@lo:400:kworker.0 Request processed in 48us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241265.931604:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1782241265.931705:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139984256:0@lo:400:kworker.0 00000100:00100000:0.0:1782241265.931821:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139983872:0@lo:400:kworker.0 00000100:00100000:0.0:1782241265.931830:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139984384:0@lo:400:kworker.0 00000100:00100000:0.0:1782241265.931859:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241265.931995:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139984896:0@lo:400:kworker.0 00000100:00100000:0.0:1782241265.932017:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241265.932050:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139984000:0@lo:400:kworker.0 00000100:00100000:0.0:1782241265.932061:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815139984512:0@lo:400:kworker.0 00000100:00100000:0.0:1782241265.932071:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f59b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815139985024:0@lo:400:kworker.0 00000100:00100000:3.0:1782241265.936333:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139984896 00000100:00100000:3.0:1782241265.936352:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139984896 00000100:00100000:3.0:1782241265.936460:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782241265.936472:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139984896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241265.936574:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139984896:12345-0@lo:400:kworker.0 Request processed in 104us (4555us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241265.936582:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:0.0:1782241265.936707:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f598700 x1868815139984896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241265.936725:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139984896:0@lo:400:kworker.0 00000100:00080000:2.0:1782241265.936862:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241265.936924:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139984384 00000100:00100000:1.0:1782241265.936930:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139984384 00000100:00100000:1.0:1782241265.936968:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1782241265.936975:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139984384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241265.937024:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139984384:12345-0@lo:400:kworker.0 Request processed in 49us (5164us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241265.937030:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782241265.937134:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139984384:0@lo:400:kworker.0 00010000:00010000:0.0:1782241266.309736:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241266.437074:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139985408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241266.437164:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241266.437483:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241266.437493:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139985536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241266.437523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241266.437698:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139985536 00000100:00100000:0.0:1782241266.437708:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139985536 00000100:00100000:0.0:1782241266.437790:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782241266.437801:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139985536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241266.437838:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782241266.437923:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139985536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241266.437941:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782241266.438065:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139985536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241266.438172:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139985408 00000100:00100000:3.0:1782241266.438177:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139985408 00000100:00100000:3.0:1782241266.438218:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782241266.438225:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139985408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782241266.438241:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241266.438290:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139985408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241266.438307:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782241266.438396:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139985408:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782241267.332959:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241267.972989:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139985664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782241267.973071:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139985792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782241267.973088:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241267.973122:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241267.973254:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139985664 00000100:00100000:1.0:1782241267.973272:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139985664 00000100:00100000:1.0:1782241267.973323:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139985792 00000100:00100000:1.0:1782241267.973326:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139985792 00000100:00100000:1.0:1782241267.973355:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782241267.973362:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f59b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139985664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782241267.973396:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241267.973450:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f59b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139985664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241267.973458:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782241267.973475:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782241267.973480:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139985792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782241267.973491:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1782241267.973539:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d661180 x1868815139985664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241267.973541:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139985792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241267.973557:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782241267.973570:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139985664:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1782241267.973645:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d997800 x1868815139985792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241267.973664:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139985792:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782241267.973852:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782241268.358687:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241269.150257:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241269.150336:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241269.150384:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241269.150407:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241269.150433:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241269.150677:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119972352 00000100:00100000:2.0:1782241269.150688:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119972352 00000100:00100000:2.0:1782241269.150752:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119972608 00000100:00100000:2.0:1782241269.150790:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119972608 00000100:00100000:2.0:1782241269.150809:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119972480 00000100:00100000:2.0:1782241269.150811:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119972480 00000100:00100000:2.0:1782241269.150823:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119972736 00000100:00100000:2.0:1782241269.150825:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119972736 00000100:00100000:2.0:1782241269.150842:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 246 00000100:00100000:2.0:1782241269.150852:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119972352:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241269.150930:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119972352:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 79us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241269.150939:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 246 00000100:00100000:2.0:1782241269.150957:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 247 00000100:00100000:2.0:1782241269.150963:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119972608:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241269.150988:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119972608:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 25us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241269.150995:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 247 00000100:00100000:2.0:1782241269.151007:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 248 00000100:00100000:2.0:1782241269.151013:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119972480:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241269.151038:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119972480:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 25us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241269.151044:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 248 00000100:00100000:2.0:1782241269.151055:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 249 00000100:00100000:2.0:1782241269.151061:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119972736:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241269.151104:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119972736:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 43us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241269.151110:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 249 00000100:00080000:0.0:1782241269.151188:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241269.151193:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782241269.154624:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119972224 00000100:00100000:3.0:1782241269.154653:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119972224 00000100:00100000:3.0:1782241269.155030:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 374 00000100:00100000:3.0:1782241269.155048:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e503e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815119972224:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241269.155173:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e503e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815119972224:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 130us (4786us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241269.155182:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 374 00010000:00010000:3.0:1782241269.381520:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782241269.524318:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000020:00000080:3.0:1782241269.524327:0:9506:0:(genops.c:906:class_export_put()) final put ffff890d47b7f800/8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000020:00000080:2.0:1782241269.524395:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47b7f800/8052d7b9-50cc-405f-b8e0-5c9d863c1c52 for lustre-OST0001 00000020:00000080:2.0:1782241269.524491:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d47b79000 for lustre-OST0001 00000100:00100000:2.0:1782241270.022339:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782241270.022373:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139985920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782241270.022480:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241270.033936:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139985920 00000100:00100000:0.0:1782241270.033959:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139985920 00000100:00100000:0.0:1782241270.034047:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782241270.034061:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139985920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241270.034132:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782241270.034307:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139985920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 249us (11826us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241270.034317:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782241270.034393:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139985920:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782241270.405005:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782241270.853461:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1782241270.918462:0:13786:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782241271.045020:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139986048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241271.045094:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241271.045098:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139986304:0@lo:400:kworker.0 00000100:00100000:0.0:1782241271.045166:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815139986560:0@lo:400:kworker.0 00000100:00100000:2.0:1782241271.045432:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241271.045473:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139986816:0@lo:400:kworker.0 00000100:00100000:2.0:1782241271.045500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241271.045522:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139987328:0@lo:400:kworker.0 00000100:00100000:2.0:1782241271.045544:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241271.045576:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1782241271.045582:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139986176:0@lo:400:kworker.0 00000100:00100000:2.0:1782241271.045613:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241271.045634:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139986688:0@lo:400:kworker.0 00000100:00100000:2.0:1782241271.045652:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241271.045670:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139987200:0@lo:400:kworker.0 00000100:00100000:2.0:1782241271.045696:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241271.045715:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139987712:0@lo:400:kworker.0 00000100:00100000:2.0:1782241271.045738:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241271.045860:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139986304 00000100:00100000:1.0:1782241271.045868:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139986304 00000100:00100000:1.0:1782241271.046314:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139986816 00000100:00100000:1.0:1782241271.046319:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139986816 00000100:00100000:0.0:1782241271.047483:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241271.056739:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139987072:0@lo:400:kworker.0 00000100:00100000:0.0:1782241271.056811:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241271.056843:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139987584:0@lo:400:kworker.0 00000100:00100000:0.0:1782241271.056864:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241271.056885:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1782241271.056892:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139986432:0@lo:400:kworker.0 00000100:00100000:0.0:1782241271.056914:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241271.056935:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815139986944:0@lo:400:kworker.0 00000100:00100000:0.0:1782241271.056958:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241271.057802:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139987200 00000100:00100000:3.0:1782241271.057810:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139987200 00000100:00100000:3.0:1782241271.057855:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139987712 00000100:00100000:3.0:1782241271.057858:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139987712 00000100:00100000:3.0:1782241271.057871:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139987072 00000100:00100000:3.0:1782241271.057873:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139987072 00000100:00100000:3.0:1782241271.057883:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139987584 00000100:00100000:3.0:1782241271.057885:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139987584 00000100:00100000:3.0:1782241271.057898:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782241271.057906:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139987200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241271.057977:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139987200:12345-0@lo:400:kworker.0 Request processed in 71us (12279us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241271.057985:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782241271.058001:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782241271.058007:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139987712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241271.058043:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139987712:12345-0@lo:400:kworker.0 Request processed in 36us (12305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241271.058048:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782241271.058059:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782241271.058065:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139987072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241271.058092:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139987072:12345-0@lo:400:kworker.0 Request processed in 27us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241271.058097:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782241271.058106:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782241271.058111:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139987584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241271.058134:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139987584:12345-0@lo:400:kworker.0 Request processed in 22us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241271.058139:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782241271.058162:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139986688 00000100:00100000:3.0:1782241271.058166:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139986688 00000100:00100000:3.0:1782241271.058193:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139986432 00000100:00100000:3.0:1782241271.058195:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139986432 00000100:00100000:3.0:1782241271.058398:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782241271.058405:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139986688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241271.058441:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139986688:12345-0@lo:400:kworker.0 Request processed in 37us (12787us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241271.058448:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782241271.058460:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782241271.058466:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139986432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241271.058493:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139986432:12345-0@lo:400:kworker.0 Request processed in 28us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241271.058508:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782241271.058586:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139986176 00000100:00100000:3.0:1782241271.058591:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139986176 00000100:00100000:3.0:1782241271.058625:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1782241271.058632:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815139986176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241271.058663:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815139986176:12345-0@lo:400:kworker.0 Request processed in 32us (13048us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241271.058669:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1782241271.060415:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139987328 00000100:00100000:1.0:1782241271.060428:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139987328 00000100:00100000:1.0:1782241271.060483:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139986560 00000100:00100000:1.0:1782241271.060487:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139986560 00000100:00100000:1.0:1782241271.060526:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1782241271.060536:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139986304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241271.060603:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139986304:12345-0@lo:400:kworker.0 Request processed in 68us (15171us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241271.060611:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1782241271.060629:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1782241271.060636:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139986816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241271.060683:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139986816:12345-0@lo:400:kworker.0 Request processed in 48us (15181us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241271.060689:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1782241271.060702:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1782241271.060708:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815139986560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241271.060734:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815139986560:12345-0@lo:400:kworker.0 Request processed in 26us (13256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241271.060740:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1782241271.060921:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1782241271.060928:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139987328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241271.060959:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139987328:12345-0@lo:400:kworker.0 Request processed in 33us (15414us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241271.060965:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1782241271.061954:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139986176:0@lo:400:kworker.0 00000100:00100000:2.0:1782241271.061985:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139986688:0@lo:400:kworker.0 00010000:00080000:2.0:1782241271.062001:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f640380 x1868815139987200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241271.062012:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139987200:0@lo:400:kworker.0 00000100:00100000:2.0:1782241271.062026:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139987712:0@lo:400:kworker.0 00000100:00100000:2.0:1782241271.062039:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139986304:0@lo:400:kworker.0 00000100:00100000:2.0:1782241271.062050:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139986816:0@lo:400:kworker.0 00000100:00100000:2.0:1782241271.062061:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139987328:0@lo:400:kworker.0 00000100:00100000:1.0:1782241271.063829:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139986944 00000100:00100000:1.0:1782241271.063840:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139986944 00000100:00100000:0.0:1782241271.063844:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815139987456:0@lo:400:kworker.0 00000100:00100000:0.0:1782241271.063903:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1782241271.063950:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f642d80 x1868815139987072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241271.063980:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139987072:0@lo:400:kworker.0 00000100:00100000:0.0:1782241271.063998:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139987584:0@lo:400:kworker.0 00000100:00100000:0.0:1782241271.064011:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815139986560:0@lo:400:kworker.0 00000100:00100000:0.0:1782241271.064041:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139986432:0@lo:400:kworker.0 00000100:00100000:0.0:1782241271.064144:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139986048 00000100:00100000:0.0:1782241271.064149:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139986048 00000100:00100000:0.0:1782241271.064179:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782241271.064186:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139986048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782241271.064300:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241271.064345:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139986048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (19251us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241271.064351:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1782241271.064370:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241271.064374:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782241271.064376:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782241271.064378:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241271.064415:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139986048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241271.064433:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139987456 00000100:00100000:0.0:1782241271.064436:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139987456 00000100:00080000:0.0:1782241271.064449:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782241271.064480:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1782241271.064487:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f59b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815139987456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241271.065029:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1782241271.065039:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f59a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815139986944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241271.067870:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f59b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815139987456:12345-0@lo:400:kworker.0 Request processed in 3373us (3956us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241271.067894:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00010000:00080000:0.0:1782241271.067971:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f643800 x1868815139987456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241271.067986:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815139987456:0@lo:400:kworker.0 00000100:00100000:1.0:1782241271.068155:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f59a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815139986944:12345-0@lo:400:kworker.0 Request processed in 3116us (11194us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241271.068165:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00010000:00080000:0.0:1782241271.069679:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f642300 x1868815139986944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241271.069695:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815139986944:0@lo:400:kworker.0 00010000:00010000:1.0:1782241271.433587:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241271.559370:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241271.559416:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139987840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241271.559539:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241271.559659:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139987840 00000100:00100000:0.0:1782241271.559670:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139987840 00000100:00100000:0.0:1782241271.559731:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782241271.559742:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139987840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241271.559799:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241271.559862:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139987840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241271.559871:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782241271.559933:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139987840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241271.560529:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139987968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241271.560572:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241271.560672:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139987968 00000100:00100000:1.0:1782241271.560679:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139987968 00000100:00100000:1.0:1782241271.560726:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1782241271.560735:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139987968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241271.560812:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241271.560877:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139987968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241271.560884:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782241271.561263:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139987968:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782241272.453151:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241273.102984:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139988096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241273.103937:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139988224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782241273.104068:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241273.105277:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139988096 00000100:00100000:3.0:1782241273.105295:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139988096 00000100:00100000:3.0:1782241273.108341:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782241273.108368:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139988096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782241273.108429:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241273.108548:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139988096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 193us (4481us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241273.108556:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782241273.108712:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241273.108799:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139988224 00000100:00100000:3.0:1782241273.108808:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139988224 00000100:00080000:1.0:1782241273.112548:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241273.121945:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782241273.121962:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139988224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782241273.122001:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241273.122118:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139988224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (13406us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241273.122126:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:3.0:1782241273.122230:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d661c00 x1868815139988224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241273.122258:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139988224:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1782241273.122312:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7d997100 x1868815139988096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241273.122326:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139988096:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1782241273.480349:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241274.269470:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241274.269561:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241274.269630:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241274.269664:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241274.269687:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241274.269721:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119973120 00000100:00100000:0.0:1782241274.269733:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119973120 00000100:00100000:0.0:1782241274.269825:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119973376 00000100:00100000:0.0:1782241274.269829:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119973376 00000100:00100000:0.0:1782241274.269843:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119972992 00000100:00100000:0.0:1782241274.269846:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119972992 00000100:00100000:0.0:1782241274.269857:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119973248 00000100:00100000:0.0:1782241274.269859:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119973248 00000100:00100000:0.0:1782241274.269876:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 256 00000100:00100000:0.0:1782241274.269887:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119973120:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241274.270446:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 257 00000100:00100000:2.0:1782241274.270458:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119973376:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241274.270531:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119973376:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 77us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241274.270540:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 257 00000100:00100000:2.0:1782241274.270565:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 258 00000100:00100000:2.0:1782241274.270572:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119972992:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241274.270599:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119972992:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 28us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241274.270605:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 258 00000100:00100000:2.0:1782241274.270617:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 259 00000100:00100000:2.0:1782241274.270631:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119973248:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241274.270654:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815119973248:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 26us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241274.270660:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 259 00000100:00100000:0.0:1782241274.271842:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815119973120:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 1946us (2268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241274.271855:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 256 00000100:00080000:0.0:1782241274.271904:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241274.271911:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782241274.273512:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119972864 00000100:00100000:3.0:1782241274.273532:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119972864 00000100:00100000:3.0:1782241274.273615:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 376 00000100:00100000:3.0:1782241274.273626:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815119972864:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241274.273789:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815119972864:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 132us (4299us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241274.273798:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 376 00010000:00010000:0.0:1782241274.501055:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241275.141731:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241275.141781:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d99a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139988352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241275.141878:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241275.142065:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139988352 00000100:00100000:1.0:1782241275.142076:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139988352 00000100:00100000:1.0:1782241275.142159:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1782241275.142171:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139988352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782241275.142218:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1782241275.142280:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139988352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241275.142289:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1782241275.142417:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d99a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139988352:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782241275.525013:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241276.180534:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139988736:0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.180676:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241276.180821:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139989248:0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.180852:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241276.180884:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815139989760:0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.180908:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241276.180953:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782241276.180960:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139988864:0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.181125:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241276.181157:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139989376:0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.181183:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241276.181206:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815139989888:0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.181232:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241276.181275:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139988736 00000100:00100000:0.0:1782241276.181285:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139988736 00000100:00100000:0.0:1782241276.181332:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139989248 00000100:00100000:0.0:1782241276.181335:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139989248 00000100:00100000:0.0:1782241276.181362:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139989760 00000100:00100000:0.0:1782241276.181366:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139989760 00000100:00100000:0.0:1782241276.181384:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139989376 00000100:00100000:0.0:1782241276.181387:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139989376 00000100:00100000:0.0:1782241276.181404:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139989888 00000100:00100000:0.0:1782241276.181407:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139989888 00000100:00100000:0.0:1782241276.181428:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1782241276.181437:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139988736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.181511:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815139988736:12345-0@lo:400:kworker.0 Request processed in 73us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241276.181520:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1782241276.181547:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1782241276.181555:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139989248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.181593:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815139989248:12345-0@lo:400:kworker.0 Request processed in 39us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241276.181600:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1782241276.181615:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1782241276.181631:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815139989760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.181668:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815139989760:12345-0@lo:400:kworker.0 Request processed in 38us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241276.181674:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1782241276.181686:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1782241276.181692:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139989376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.181721:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139989376:12345-0@lo:400:kworker.0 Request processed in 30us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241276.181728:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1782241276.181743:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1782241276.181750:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815139989888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.181823:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815139989888:12345-0@lo:400:kworker.0 Request processed in 74us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241276.181830:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1782241276.181868:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139988864 00000100:00100000:0.0:1782241276.181873:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139988864 00000100:00100000:0.0:1782241276.181909:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1782241276.181916:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139988864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.181956:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139988864:12345-0@lo:400:kworker.0 Request processed in 40us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241276.181963:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1782241276.182361:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241276.182367:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241276.182409:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139988864:0@lo:400:kworker.0 00010000:00080000:0.0:1782241276.182429:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4809a300 x1868815139989376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241276.182453:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139989376:0@lo:400:kworker.0 00010000:00080000:0.0:1782241276.182471:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4809b800 x1868815139989888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241276.182480:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815139989888:0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.182491:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815139988736:0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.182504:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815139989248:0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.182516:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815139989760:0@lo:400:kworker.0 00000100:00100000:1.0:1782241276.182994:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139988480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241276.185257:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139988608:0@lo:400:kworker.0 00000100:00100000:3.0:1782241276.185471:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241276.185598:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139989120:0@lo:400:kworker.0 00000100:00100000:3.0:1782241276.185633:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241276.185661:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139989632:0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.185926:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139988608 00000100:00100000:0.0:1782241276.185936:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139988608 00000100:00100000:0.0:1782241276.186005:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1782241276.186017:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139988608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.186138:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139988608:12345-0@lo:400:kworker.0 Request processed in 123us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241276.186147:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1782241276.186239:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241276.186271:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139990144:0@lo:400:kworker.0 00000100:00100000:3.0:1782241276.186302:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241276.186588:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139988608:0@lo:400:kworker.0 00000100:00100000:3.0:1782241276.186638:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139989632 00000100:00100000:3.0:1782241276.186663:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139989632 00000100:00100000:0.0:1782241276.186713:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139990144 00000100:00100000:0.0:1782241276.186718:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139990144 00000100:00100000:0.0:1782241276.186776:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782241276.186785:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139990144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241276.186853:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782241276.186861:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139989632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241276.186987:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139990144:12345-0@lo:400:kworker.0 Request processed in 202us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241276.186994:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782241276.186995:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139989632:12345-0@lo:400:kworker.0 Request processed in 136us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241276.187001:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1782241276.187017:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782241276.187021:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782241276.187044:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48098700 x1868815139989632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241276.187058:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139989632:0@lo:400:kworker.0 00000100:00100000:3.0:1782241276.187069:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139990144:0@lo:400:kworker.0 00000100:00100000:1.0:1782241276.190540:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241276.190728:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139989120 00000100:00100000:3.0:1782241276.190734:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139988480 00000100:00100000:3.0:1782241276.190742:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139988480 00000100:00100000:2.0:1782241276.190742:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139989120 00000100:00100000:3.0:1782241276.190835:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782241276.190836:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139988992:0@lo:400:kworker.0 00000100:00100000:3.0:1782241276.190850:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139988480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782241276.190900:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241276.190924:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241276.190958:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139988992 00000100:00100000:1.0:1782241276.190963:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139988992 00000100:00100000:3.0:1782241276.190965:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815139988480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (7909us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241276.190975:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782241276.191004:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1782241276.191012:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139988992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241276.191048:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139988992:12345-0@lo:400:kworker.0 Request processed in 37us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241276.191186:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1782241276.191236:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139988992:0@lo:400:kworker.0 00000100:00100000:1.0:1782241276.191260:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139989504:0@lo:400:kworker.0 00000100:00100000:1.0:1782241276.191291:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241276.191320:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139990016:0@lo:400:kworker.0 00000100:00100000:1.0:1782241276.191340:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241276.191435:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139989504 00000100:00100000:1.0:1782241276.191440:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139989504 00000100:00100000:1.0:1782241276.191475:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139990016 00000100:00100000:1.0:1782241276.191478:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139990016 00000100:00100000:1.0:1782241276.191504:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782241276.191511:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139989504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241276.191544:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139989504:12345-0@lo:400:kworker.0 Request processed in 34us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241276.191551:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782241276.191564:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782241276.191570:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139990016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241276.191597:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139990016:12345-0@lo:400:kworker.0 Request processed in 27us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241276.191603:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782241276.191629:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139990016:0@lo:400:kworker.0 00000100:00100000:1.0:1782241276.191670:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139988480:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1782241276.191683:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48098380 x1868815139989504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241276.191693:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139989504:0@lo:400:kworker.0 00000100:00100000:2.0:1782241276.191835:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1782241276.191843:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139989120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241276.191919:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139989120:12345-0@lo:400:kworker.0 Request processed in 77us (6285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241276.191925:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1782241276.197661:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782241276.197679:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241276.197789:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139989120:0@lo:400:kworker.0 00000001:02000400:3.0:1782241276.251377:0:14067:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 15:01:14 (1782241274) 00010000:00010000:2.0:1782241276.549001:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241276.677409:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782241276.677463:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139990272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241276.677563:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241276.677725:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139990272 00000100:00100000:0.0:1782241276.677736:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139990272 00000100:00100000:0.0:1782241276.677833:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782241276.677845:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139990272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241276.677875:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241276.677982:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139990272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 139us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241276.677991:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782241276.678235:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139990272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241276.680450:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139990400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241276.680573:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241276.682121:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139990400 00000100:00100000:0.0:1782241276.682141:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139990400 00000100:00100000:0.0:1782241276.682240:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782241276.682252:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e48128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139990400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241276.682305:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782241276.682444:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e48128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139990400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 193us (1870us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241276.682452:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782241276.682644:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139990400:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782241277.574363:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241278.207103:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241278.207266:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119973504 00000100:00100000:1.0:1782241278.207280:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119973504 00000100:00100000:1.0:1782241278.207378:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 40 00000100:00100000:1.0:1782241278.207394:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4812a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:11086:x1868815119973504:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782241278.207422:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241278.207454:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e199cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335050fc expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.207542:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e199d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.207559:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e199d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.207575:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e199d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241278.207638:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782241278.207642:0:10147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241278.207688:0:10147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e199d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782241278.207724:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782241278.207730:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e199cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050fc expref: 7 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.207814:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e199d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050fc expref: 6 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.207826:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e81fbc500) 00010000:00010000:1.0:1782241278.207847:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782241278.207852:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb800, rc 0) 00000100:00100000:1.0:1782241278.207934:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4812a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:11086:x1868815119973504:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 544us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241278.207944:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 40 00000100:00100000:0.0:1782241278.213130:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782241278.215315:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139990656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241278.215440:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241278.215556:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e48128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139990528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782241278.215617:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241278.216278:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139990656 00000100:00100000:3.0:1782241278.216290:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139990656 00000100:00100000:3.0:1782241278.216359:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139990528 00000100:00100000:3.0:1782241278.216362:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139990528 00000100:00100000:3.0:1782241278.216381:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782241278.216390:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139990656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782241278.216435:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1782241278.216471:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241278.217366:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139990656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 970us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241278.217379:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782241278.217413:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1782241278.217425:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139990528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782241278.217443:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241278.217505:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139990528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241278.217511:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:0.0:1782241278.219699:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7785b100 x1868815139990656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241278.219738:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139990656:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1782241278.226641:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e48128380 x1868815139990528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241278.226685:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e48128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139990528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782241278.230105:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241278.232037:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119973632 00000100:00100000:1.0:1782241278.232061:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119973632 00000100:00100000:1.0:1782241278.232158:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 41 00000100:00100000:1.0:1782241278.232172:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:11087:x1868815119973632:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782241278.232201:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241278.232230:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e199da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505103 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.232551:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e199e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.232571:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e199e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.232587:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e199e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.232604:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e199e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.232611:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e199e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.232617:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e199e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.232718:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e199ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.232726:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e199ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.232733:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e199ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241278.232807:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782241278.232812:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241278.232839:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e199ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.232916:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e199e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.232923:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e199e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.232930:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e199e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.232936:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241278.232941:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e199e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.232949:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e199e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.232964:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e81fbc500) 00010000:00010000:1.0:1782241278.232974:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241278.232979:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e199e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.232986:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e199e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.233000:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e199e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.233005:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e199e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.233010:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e199e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.233014:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eae00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241278.233017:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e199e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.233023:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e199e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.233029:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff890e81fbc800) 00010000:00010000:1.0:1782241278.233031:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241278.233033:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e199e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.233039:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e199e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.233138:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e199da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505103 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.233168:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e199ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505103 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.233176:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff890e81fbcd00) 00010000:00010000:1.0:1782241278.233179:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782241278.233181:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb000, rc 0) 00000100:00100000:1.0:1782241278.233394:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:11087:x1868815119973632:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 1224us (3328us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241278.233404:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 41 00000100:00100000:3.0:1782241278.241803:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241278.245289:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119973760 00000100:00100000:1.0:1782241278.245314:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119973760 00000100:00100000:1.0:1782241278.245428:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:1.0:1782241278.245441:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e48128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:11087:x1868815119973760:12345-192.168.204.58@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1782241278.249559:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e48128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:11087:x1868815119973760:12345-192.168.204.58@tcp:900:lhsmtool_posix.0 Request processed in 4101us (7794us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241278.249580:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:3.0:1782241278.256558:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241278.256694:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119974016 00000100:00100000:1.0:1782241278.256707:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119974016 00000100:00100000:1.0:1782241278.256827:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 42 00000100:00100000:1.0:1782241278.256841:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4812b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:11087:x1868815119974016:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782241278.256885:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241278.256912:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e199f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350510a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.257014:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e199fd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.257052:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e199fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.257075:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e199fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.258639:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e19a04 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.258663:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e19a04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.258677:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e19a04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.258832:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eaa00/0xc9959f2fb1e19a0b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.258841:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eaa00/0xc9959f2fb1e19a0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.258847:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eaa00/0xc9959f2fb1e19a0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241278.258858:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1782241278.258955:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e199fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.258964:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e199fd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.258971:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e199fd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.258994:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241278.258999:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e199fd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.259009:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e199fd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.259022:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff890e81fbcd00) 00010000:00010000:1.0:1782241278.259025:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241278.259030:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e199fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.259036:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e199fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.259050:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e19a04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.259057:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e19a04 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.259075:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e19a04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.259080:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241278.259083:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e19a04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.259091:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e19a04 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.259109:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff890e81fbc000) 00010000:00010000:1.0:1782241278.259112:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241278.259115:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e19a04 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.259121:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e19a04 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.259403:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e199f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350510a expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.265905:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eaa00/0xc9959f2fb1e19a0b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350510a expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241278.265923:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890e81fbc300) 00010000:00010000:1.0:1782241278.265927:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241278.265930:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eaa00, rc 0) 00000100:00100000:1.0:1782241278.266427:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4812b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:11087:x1868815119974016:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 9586us (9880us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1782241278.266442:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 42 00000100:00100000:2.0:1782241278.274197:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241278.274346:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119974144 00000100:00100000:0.0:1782241278.274361:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119974144 00000100:00100000:1.0:1782241278.275399:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 43 00000100:00100000:1.0:1782241278.275425:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d99a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:11087:x1868815119974144:12345-192.168.204.58@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1782241278.275560:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d99a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:11087:x1868815119974144:12345-192.168.204.58@tcp:59:lhsmtool_posix.0 Request processed in 147us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241278.275567:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 43 00000100:00100000:0.0:1782241278.279080:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241278.279146:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119974272 00000100:00100000:1.0:1782241278.279175:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119974272 00000100:00100000:1.0:1782241278.279257:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 44 00000100:00100000:1.0:1782241278.279270:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:11087:x1868815119974272:12345-192.168.204.58@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1782241278.280120:0:6510:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 808us 00000100:00080000:0.0:1782241278.280371:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782241278.320602:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:11087:x1868815119974272:12345-192.168.204.58@tcp:59:lhsmtool_posix.0 Request processed in 41320us (41530us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241278.320633:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 44 00010000:00010000:0.0:1782241278.597244:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782241279.047100:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1782241279.112912:0:13786:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782241279.394909:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241279.394957:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241279.394979:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241279.395000:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241279.395023:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241279.395071:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119974656 00000100:00100000:3.0:1782241279.395083:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119974656 00000100:00100000:3.0:1782241279.395142:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119974912 00000100:00100000:3.0:1782241279.395145:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119974912 00000100:00100000:3.0:1782241279.395172:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119974528 00000100:00100000:3.0:1782241279.395174:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119974528 00000100:00100000:3.0:1782241279.395185:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119974784 00000100:00100000:3.0:1782241279.395187:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119974784 00000100:00100000:3.0:1782241279.395208:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 266 00000100:00100000:3.0:1782241279.395219:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4812b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119974656:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241279.395326:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4812b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119974656:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 108us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241279.395336:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 266 00000100:00100000:3.0:1782241279.395372:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 267 00000100:00100000:3.0:1782241279.395379:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e48129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119974912:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241279.395415:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e48129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119974912:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 37us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241279.395421:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 267 00000100:00100000:3.0:1782241279.395433:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 268 00000100:00100000:3.0:1782241279.395440:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e48128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2398:x1868815119974528:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241279.395481:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e48128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2398:x1868815119974528:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 42us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241279.395488:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 268 00000100:00100000:3.0:1782241279.395500:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 269 00000100:00100000:3.0:1782241279.395506:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e48129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119974784:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241279.395530:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e48129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119974784:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 25us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241279.395536:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 269 00000100:00100000:0.0:1782241279.398236:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119974400 00000100:00100000:0.0:1782241279.398257:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119974400 00000100:00100000:0.0:1782241279.398341:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 378 00000100:00100000:0.0:1782241279.398353:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2398:x1868815119974400:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241279.398454:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2398:x1868815119974400:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 103us (3562us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241279.398462:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 378 00000100:00080000:0.0:1782241279.398512:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241279.398519:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1782241279.621549:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782241280.072180:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1782241280.136592:0:13786:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782241280.263051:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782241280.263082:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e4812ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139990784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241280.263178:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241280.263275:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139990784 00000100:00100000:3.0:1782241280.263285:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139990784 00000100:00100000:3.0:1782241280.263347:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782241280.263357:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4812b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139990784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782241280.263407:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782241280.263462:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4812b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139990784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241280.263471:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782241280.263531:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e4812ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139990784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241280.551127:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241280.551289:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119975040 00000100:00100000:1.0:1782241280.551304:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119975040 00000100:00100000:1.0:1782241280.551378:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 45 00000100:00100000:1.0:1782241280.551388:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4812ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:11129:x1868815119975040:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241280.551417:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241280.551441:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19a19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505111 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551533:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e19a20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551552:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e19a20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551567:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e19a20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551584:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19a27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551591:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19a27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551599:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19a27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551662:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e19a20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551669:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e19a20 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551674:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e19a20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551678:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eba00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241280.551682:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e19a20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551688:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e19a20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551700:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e81fbc500) 00010000:00010000:1.0:1782241280.551702:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241280.551706:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e19a20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551710:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e19a20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551721:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19a27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551725:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19a27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551729:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19a27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551739:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241280.551742:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19a27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551745:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19a27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551750:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff890e81fbc000) 00010000:00010000:1.0:1782241280.551752:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241280.551753:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19a27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551776:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19a27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551819:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19a19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505111 expref: 10 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551827:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e81fbc500) 00010000:00010000:1.0:1782241280.551829:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241280.551832:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19a19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505111 expref: 10 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.551838:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ebc00, rc 0) 00000100:00080000:0.0:1782241280.553330:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241280.553993:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4812ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:11129:x1868815119975040:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 526us (797us total) trans 0 rc 301/301 00000100:00100000:1.0:1782241280.554010:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 45 00000100:00100000:0.0:1782241280.559886:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241280.562894:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119975296 00000100:00100000:3.0:1782241280.562915:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119975296 00000100:00100000:3.0:1782241280.564560:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 46 00000100:00100000:3.0:1782241280.564582:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:11129:x1868815119975296:12345-192.168.204.58@tcp:36:lfs.0 00010000:00010000:3.0:1782241280.564667:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241280.564705:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e199d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050fc expref: 9 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.564726:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e81fbc500) 00010000:00010000:3.0:1782241280.564741:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782241280.564842:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181600/0xc9959f2fb1e19a2e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.564857:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181600/0xc9959f2fb1e19a2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.564870:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181600/0xc9959f2fb1e19a2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.564884:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181200/0xc9959f2fb1e19a35 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.564891:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181200/0xc9959f2fb1e19a35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.564897:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181200/0xc9959f2fb1e19a35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.565553:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181a00/0xc9959f2fb1e19a3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.565566:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181a00/0xc9959f2fb1e19a3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.565573:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181a00/0xc9959f2fb1e19a3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782241280.565600:0:6510:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a563ed74 reply state 00000000e07e267e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181a00/0xc9959f2fb1e19a3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.565612:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181a00/0xc9959f2fb1e19a3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.565619:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:3.0:1782241280.565623:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782241280.565626:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782241280.565633:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1782241280.565640:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181600/0xc9959f2fb1e19a2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.565647:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181600/0xc9959f2fb1e19a2e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.565654:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181600/0xc9959f2fb1e19a2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.565661:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e47181600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241280.565666:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181600/0xc9959f2fb1e19a2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.565675:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181600/0xc9959f2fb1e19a2e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.565685:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e528b3300) 00010000:00010000:3.0:1782241280.565688:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241280.565692:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181600/0xc9959f2fb1e19a2e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.565708:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181600/0xc9959f2fb1e19a2e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782241280.565727:0:6510:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a563ed74 reply state 00000000e07e267e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181200/0xc9959f2fb1e19a35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.565736:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181200/0xc9959f2fb1e19a35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.565742:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff890e528b3c00) 00010000:00010000:3.0:1782241280.565745:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782241280.565747:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1782241280.565926:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+10:11129:x1868815119975296:12345-192.168.204.58@tcp:36:lfs.0 Request processed in 1347us (6052us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1782241280.565936:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 46 00010000:00010000:2.0:1782241280.645253:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241280.683751:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241280.683884:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119975424 00000100:00100000:0.0:1782241280.683898:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119975424 00000100:00100000:0.0:1782241280.683987:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 47 00000100:00100000:0.0:1782241280.683999:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4812a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+10:11137:x1868815119975424:12345-192.168.204.58@tcp:101:lctl.0 00010000:00010000:0.0:1782241280.684041:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241280.684074:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19a43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505118 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241280.684160:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e19a4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241280.684197:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e19a4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241280.684212:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e19a4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241280.684289:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782241280.684294:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241280.684340:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e19a4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241280.684381:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19a43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505118 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241280.684403:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e19a4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505118 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241280.684413:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b500) 00010000:00010000:0.0:1782241280.684416:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782241280.684420:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0000, rc 0) 00000100:00100000:0.0:1782241280.684682:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4812a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:11137:x1868815119975424:12345-192.168.204.58@tcp:101:lctl.0 Request processed in 684us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241280.684690:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 47 00000100:00100000:1.0:1782241280.787267:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241280.787443:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119975552 00000100:00100000:3.0:1782241280.787456:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119975552 00000100:00100000:3.0:1782241280.787614:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 48 00000100:00100000:3.0:1782241280.787627:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:11143:x1868815119975552:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:3.0:1782241280.787654:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241280.787680:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181600/0xc9959f2fb1e19a51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350511f expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.787813:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180600/0xc9959f2fb1e19a58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.787830:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180600/0xc9959f2fb1e19a58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.787855:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180600/0xc9959f2fb1e19a58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.787870:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181c00/0xc9959f2fb1e19a5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.787878:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181c00/0xc9959f2fb1e19a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.787885:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181c00/0xc9959f2fb1e19a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.787991:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180200/0xc9959f2fb1e19a66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.787999:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180200/0xc9959f2fb1e19a66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788005:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180200/0xc9959f2fb1e19a66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241280.788063:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1782241280.788067:0:11191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782241280.788118:0:11191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180200/0xc9959f2fb1e19a66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788138:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180600/0xc9959f2fb1e19a58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788145:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180600/0xc9959f2fb1e19a58 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788166:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180600/0xc9959f2fb1e19a58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788172:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e47180600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241280.788177:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180600/0xc9959f2fb1e19a58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788185:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180600/0xc9959f2fb1e19a58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788200:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b500) 00010000:00010000:3.0:1782241280.788203:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241280.788208:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180600/0xc9959f2fb1e19a58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788215:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180600/0xc9959f2fb1e19a58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788233:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181c00/0xc9959f2fb1e19a5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788239:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181c00/0xc9959f2fb1e19a5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788244:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181c00/0xc9959f2fb1e19a5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788249:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e47181c00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241280.788251:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181c00/0xc9959f2fb1e19a5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788268:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181c00/0xc9959f2fb1e19a5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788277:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff890e528b3c00) 00010000:00010000:3.0:1782241280.788279:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241280.788282:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181c00/0xc9959f2fb1e19a5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788288:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181c00/0xc9959f2fb1e19a5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788321:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181600/0xc9959f2fb1e19a51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350511f expref: 13 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788335:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180200/0xc9959f2fb1e19a66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350511f expref: 12 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.788343:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:3.0:1782241280.788345:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782241280.788348:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e47180200, rc 0) 00000100:00100000:3.0:1782241280.788430:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+12:11143:x1868815119975552:12345-192.168.204.58@tcp:101:bash.0 Request processed in 805us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241280.788439:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 48 00000100:00100000:2.0:1782241280.792607:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241280.794266:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119975808 00000100:00100000:3.0:1782241280.794284:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119975808 00000100:00100000:3.0:1782241280.794379:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 49 00000100:00100000:3.0:1782241280.794391:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+12:11143:x1868815119975808:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:3.0:1782241280.794562:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241280.794593:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e82057800/0xc9959f2fb1e19a6d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505126 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.794736:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e19a74 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.794771:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e19a74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.794786:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e19a74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.795092:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19a7b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.795118:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19a7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.795133:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19a7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782241280.796729:0:6510:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1782241280.796922:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e19a82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.796938:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e19a82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.796948:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e19a82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.797159:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e19a74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.797166:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e19a74 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.797172:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e19a74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.797178:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241280.797182:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e19a74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.797399:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e19a74 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.797414:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:3.0:1782241280.797417:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241280.797422:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e19a74 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.797428:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e19a74 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782241280.797443:0:6510:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dabd3254 reply state 000000009a214e63 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19a7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.797453:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19a7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.797459:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890e528b3300) 00010000:00010000:3.0:1782241280.797467:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782241280.797471:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782241280.797513:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e82057800/0xc9959f2fb1e19a6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505126 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.797530:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e19a82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505126 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.797536:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3600) 00010000:00010000:3.0:1782241280.797538:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782241280.797540:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164ca00, rc 0) 00000100:00100000:3.0:1782241280.797699:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+15:11143:x1868815119975808:12345-192.168.204.58@tcp:101:bash.0 Request processed in 3309us (5103us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1782241280.797708:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 49 00000100:00100000:1.0:1782241280.807144:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241280.807467:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119975936 00000100:00100000:3.0:1782241280.807478:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119975936 00000100:00100000:3.0:1782241280.807557:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 28 00000100:00100000:3.0:1782241280.807566:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1868815119975936:12345-192.168.204.58@tcp:8:bash.0 00010000:00080000:3.0:1782241280.807605:0:8425:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp t0 exp 0000000000000000 cur 344 last 0 00000020:00000080:3.0:1782241280.807635:0:8425:0:(genops.c:1406:class_connect()) connect: client 8052d7b9-50cc-405f-b8e0-5c9d863c1c52, cookie 0xc9959f2fb1e19a90 00002000:00100000:3.0:1782241280.807646:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8052d7b9-50cc-405f-b8e0-5c9d863c1c52/ffff890d46660800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782241280.807664:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782241280.807739:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782241280.807803:0:8425:0:(import.c:65:import_set_state_nolock()) ffff890d46665000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782241280.807880:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2395:x1868815119975936:12345-192.168.204.58@tcp:8:bash.0 Request processed in 313us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241280.807888:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 28 00000100:00100000:1.0:1782241280.812999:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241280.813136:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119976064 00000100:00100000:0.0:1782241280.813147:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119976064 00000100:00100000:0.0:1782241280.813231:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00100000:0.0:1782241280.813247:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:0:x1868815119976064:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:0.0:1782241280.813265:0:8746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241280.813303:0:8746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d81ed0cf/0xc9959f2fb1e19a97 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350512d expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782241280.813332:0:8746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241280.813350:0:8746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1782241280.813355:0:8746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241280.813365:0:8746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d81ed0cf/0xc9959f2fb1e19a97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350512d expref: 7 pid: 8746 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241280.813384:0:8746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d81ed0cf/0xc9959f2fb1e19a97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350512d expref: 7 pid: 8746 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241280.813398:0:8746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1a00, rc 0) 00000100:00080000:2.0:1782241280.813422:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241280.813472:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:0:x1868815119976064:12345-192.168.204.58@tcp:101:bash.0 Request processed in 227us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241280.813480:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00100000:2.0:1782241280.822966:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241280.823105:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119976192 00000100:00100000:3.0:1782241280.823115:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119976192 00000100:00100000:3.0:1782241280.823228:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 30 00000100:00100000:3.0:1782241280.823240:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:11143:x1868815119976192:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:3.0:1782241280.823267:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241280.823288:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505134 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.823320:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d81ed0cf/0xc9959f2fb1e19a97 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350512d expref: 8 pid: 8746 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241280.823876:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241280.823888:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241280.823894:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505134 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241280.824007:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d81ed0cf/0xc9959f2fb1e19a97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350512d expref: 8 pid: 8746 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241280.824035:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d81ed0cf/0xc9959f2fb1e19a97 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350512d expref: 8 pid: 8746 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241280.824071:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f643480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8426:1868815139990912:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241280.824178:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47ac1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782241280.826697:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f643480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8426:1868815139990912:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241280.826731:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505134 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241280.826751:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c600, rc 0) 00000100:00100000:2.0:1782241280.826871:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:11143:x1868815119976192:12345-192.168.204.58@tcp:101:bash.0 Request processed in 3634us (3913us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241280.826889:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 30 00000100:00100000:3.0:1782241280.831958:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241280.832145:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119976320 00000100:00100000:1.0:1782241280.832155:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119976320 00010000:00010000:1.0:1782241280.832325:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d81ed0cf/0xc9959f2fb1e19a97 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350512d expref: 8 pid: 8746 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241280.832403:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 52 00000100:00100000:1.0:1782241280.832413:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e477c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2399:x1868815119976320:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241280.832429:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241280.832460:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d81ed0cf/0xc9959f2fb1e19a97 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350512d expref: 8 pid: 8746 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.832475:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d81ed0cf/0xc9959f2fb1e19a97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350512d expref: 8 pid: 8746 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.832501:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d81ed0cf/0xc9959f2fb1e19a97 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350512d expref: 8 pid: 8746 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.832518:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241280.832522:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241280.832530:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505134 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.832539:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505134 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.832595:0:6495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505134 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241280.832611:0:6495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6495:1868815139991040:192.168.204.58@tcp:105: 00000100:00100000:1.0:1782241280.832699:0:6495:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d479343c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241280.848796:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241280.848940:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119976576 00000100:00100000:2.0:1782241280.848949:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119976576 00000100:00100000:2.0:1782241280.849024:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 6 00000100:00100000:2.0:1782241280.849035:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+15:11143:x1868815119976576:12345-192.168.204.58@tcp:35:bash.0 00000100:00100000:2.0:1782241280.849346:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+16:11143:x1868815119976576:12345-192.168.204.58@tcp:35:bash.0 Request processed in 311us (598us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1782241280.849354:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 6 00000100:00100000:1.0:1782241280.849745:0:6495:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6495:1868815139991040:192.168.204.58@tcp:105: 00010000:00010000:1.0:1782241280.849800:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241280.852114:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e477c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2399:x1868815119976320:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 19690us (20154us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241280.852132:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 52 00000100:00100000:0.0:1782241280.923562:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241280.925140:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119976832 00000100:00100000:1.0:1782241280.925156:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119976832 00000100:00100000:1.0:1782241280.925357:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 50 00000100:00100000:1.0:1782241280.925368:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+16:11153:x1868815119976832:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241280.925394:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241280.925416:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19aa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350513b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241280.925528:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1782241280.925632:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19aa5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350513b expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.925646:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b500) 00010000:00010000:1.0:1782241280.925649:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782241280.925668:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19aa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350513b expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241280.925681:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb400, rc 0) 00000100:00100000:1.0:1782241280.926820:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+17:11153:x1868815119976832:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 1447us (3261us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1782241280.926831:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 50 00000100:00100000:2.0:1782241280.943351:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241280.943537:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119977088 00000100:00100000:0.0:1782241280.943547:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119977088 00000100:00100000:0.0:1782241280.943606:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:0.0:1782241280.943616:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+17:11153:x1868815119977088:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:0.0:1782241280.943898:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:11153:x1868815119977088:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 282us (556us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1782241280.943907:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:3.0:1782241281.018599:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241281.019268:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119977216 00000100:00100000:1.0:1782241281.019279:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119977216 00000100:00100000:1.0:1782241281.019341:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 51 00000100:00100000:1.0:1782241281.019351:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e48129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:11159:x1868815119977216:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241281.019379:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241281.019400:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19ab3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505142 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.019470:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19aba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.019484:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19aba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.019496:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19aba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241281.019543:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1782241281.019547:0:11191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241281.019566:0:11191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19aba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.019595:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19ab3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505142 expref: 20 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.019630:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19aba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505142 expref: 19 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.019639:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:1.0:1782241281.019643:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782241281.019646:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ebc00, rc 0) 00000100:00100000:1.0:1782241281.019716:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e48129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:11159:x1868815119977216:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 367us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241281.019724:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 51 00000100:00100000:2.0:1782241281.025066:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241281.025153:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119977472 00000100:00100000:3.0:1782241281.025162:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119977472 00000100:00100000:3.0:1782241281.025213:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 52 00000100:00100000:3.0:1782241281.025224:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:11159:x1868815119977472:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241281.025247:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241281.025278:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e19ac1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505149 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.025384:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e19ac8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.025412:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e19ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.025423:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e19ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241281.025436:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1782241281.025554:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e19ac1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505149 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.025572:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e19ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505149 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.025581:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3600) 00010000:00010000:3.0:1782241281.025584:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782241281.025587:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d200, rc 0) 00000100:00100000:3.0:1782241281.025656:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:11159:x1868815119977472:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 433us (599us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1782241281.025663:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 52 00000100:00100000:0.0:1782241281.031218:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241281.033243:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241281.033525:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119977856 00000100:00100000:0.0:1782241281.033535:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119977856 00000100:00100000:0.0:1782241281.033594:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 53 00000100:00100000:0.0:1782241281.033604:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:11159:x1868815119977856:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241281.033629:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241281.033649:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19ad6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505150 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.033803:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e19add lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.033818:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e19add lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.033830:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e19add lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241281.033845:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1782241281.033952:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19ad6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505150 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.033986:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e19add lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505150 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.033996:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3600) 00010000:00010000:0.0:1782241281.034000:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782241281.034003:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0600, rc 0) 00000100:00100000:0.0:1782241281.034089:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+23:11159:x1868815119977856:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 486us (854us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1782241281.034111:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 53 00000100:00100000:1.0:1782241281.035899:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119977600 00000100:00100000:1.0:1782241281.035914:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119977600 00000100:00100000:1.0:1782241281.035985:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:1.0:1782241281.035997:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+23:2399:x1868815119977600:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241281.036020:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241281.036044:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e19ac8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505149 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.036061:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3600) 00010000:00010000:1.0:1782241281.036066:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241281.036158:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:2399:x1868815119977600:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 163us (4949us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241281.036166:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:2.0:1782241281.047217:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241281.047351:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119977984 00000100:00100000:3.0:1782241281.047361:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119977984 00000100:00100000:3.0:1782241281.047421:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 31 00000100:00100000:3.0:1782241281.047431:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2398:x1868815119977984:12345-192.168.204.58@tcp:1:lfs.0 00010000:00010000:3.0:1782241281.047484:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006071cf3e/0xc9959f2fb1e19aeb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.047504:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505134 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.047526:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241281.047530:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782241281.047534:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006071cf3e/0xc9959f2fb1e19aeb lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.047571:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505134 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.047586:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505134 expref: 7 pid: 8426 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241281.047602:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e4812bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8425:1868815139991168:192.168.204.58@tcp:104: 00000100:00100000:3.0:1782241281.047727:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d46869300 going to sleep for 11 seconds 00000100:00100000:3.0:1782241281.052217:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e4812bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8425:1868815139991168:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241281.052250:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006071cf3e/0xc9959f2fb1e19aeb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241281.052283:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241281.052681:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119978112 00000100:00100000:2.0:1782241281.052689:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119978112 00002000:00100000:2.0:1782241281.052735:0:8429:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff890d477f8380 x1868815119978112/t0(0) o4->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:372/0 lens 504/0 e 0 to 0 dl 1782241292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782241281.052785:0:8429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d477f8380 with x1868815119978112 ext(0->12) 00010000:00010000:2.0:1782241281.052794:0:8429:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505134 expref: 8 pid: 8426 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.052809:0:8429:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505134 expref: 8 pid: 8426 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782241281.052817:0:8429:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff890d477f8380 00000100:00100000:2.0:1782241281.052855:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:2.0:1782241281.052865:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2398:x1868815119978112:12345-192.168.204.58@tcp:4:lfs.0 00000001:00100000:0.0:1782241281.054590:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000100:00100000:2.0:1782241281.055281:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2398:x1868815119978112:12345-192.168.204.58@tcp:4:lfs.0 Request processed in 2410us (2992us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1782241281.055294:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 0 00002000:00100000:2.0:1782241281.055306:0:8429:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff890d477f8380 x1868815119978112/t4294967300(0) o4->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:372/0 lens 504/448 e 0 to 0 dl 1782241292 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782241281.055317:0:8429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d477f8380 with x1868815119978112 ext(0->12) 00010000:00010000:2.0:1782241281.055328:0:8429:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505134 expref: 9 pid: 8426 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.055346:0:8429:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505134 expref: 9 pid: 8426 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782241281.055354:0:8429:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff890d477f8380 00000100:00100000:0.0:1782241281.058485:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241281.058572:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119978240 00000100:00100000:1.0:1782241281.058581:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119978240 00010000:00010000:1.0:1782241281.058622:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505134 expref: 9 pid: 8426 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241281.058681:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 53 00000100:00100000:1.0:1782241281.058690:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2399:x1868815119978240:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241281.058707:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1782241281.058726:0:10330:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1782241281.058729:0:10330:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1782241281 00002000:00010000:1.0:1782241281.058731:0:10330:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1782241281 00002000:00010000:1.0:1782241281.058733:0:10330:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1782241281 00002000:00010000:1.0:1782241281.058735:0:10330:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1782241281.058740:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505134 expref: 9 pid: 8426 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.058753:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505134 expref: 9 pid: 8426 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.058792:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086711b8d/0xc9959f2fb1e19a9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505134 expref: 9 pid: 8426 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.058810:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782241281.058815:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782241281.058820:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006071cf3e/0xc9959f2fb1e19aeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.058829:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006071cf3e/0xc9959f2fb1e19aeb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.058868:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241281.059209:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2399:x1868815119978240:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 518us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241281.059217:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 53 00010000:00010000:1.0:1782241281.059247:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006071cf3e/0xc9959f2fb1e19aeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.059256:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006071cf3e/0xc9959f2fb1e19aeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.059275:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006071cf3e/0xc9959f2fb1e19aeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.059284:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006071cf3e/0xc9959f2fb1e19aeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.059293:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006071cf3e/0xc9959f2fb1e19aeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.059301:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241281.059306:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006071cf3e/0xc9959f2fb1e19aeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.059315:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006071cf3e/0xc9959f2fb1e19aeb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.059341:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006071cf3e/0xc9959f2fb1e19aeb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.059349:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006071cf3e/0xc9959f2fb1e19aeb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241281.062829:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2398:x1868815119977984:12345-192.168.204.58@tcp:1:lfs.0 Request processed in 15385us (15606us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241281.062843:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 31 00000100:00100000:3.0:1782241281.063169:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241281.063630:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119978496 00000100:00100000:0.0:1782241281.063640:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119978496 00000100:00100000:0.0:1782241281.063694:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 8 00000100:00100000:0.0:1782241281.063709:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4812bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:11159:x1868815119978496:12345-192.168.204.58@tcp:35:lfs.0 00000004:00010000:0.0:1782241281.063801:0:6514:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e19add lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505150 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782241281.064042:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1782241281.064100:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1782241281.067019:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1782241281.067148:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19af2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.067167:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e19a82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505126 expref: 26 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.067176:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19af2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.067285:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e19a82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505126 expref: 26 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.067303:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e19a82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505126 expref: 26 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241281.067337:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477fb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1868815139991296:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241281.067544:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e779636c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241281.070565:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477fb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1868815139991296:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241281.070609:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19af2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241281.070681:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241281.070963:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119978624 00000100:00100000:1.0:1782241281.070971:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119978624 00010000:00010000:1.0:1782241281.071016:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e19a82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505126 expref: 27 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241281.071057:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 54 00000100:00100000:1.0:1782241281.071066:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:2398:x1868815119978624:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241281.071175:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241281.071296:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e19a82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505126 expref: 27 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.071306:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e19a82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505126 expref: 27 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.071324:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e19a82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505126 expref: 27 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.071345:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3600) 00010000:00010000:1.0:1782241281.071348:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19af2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.071354:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19af2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.071359:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19af2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.071409:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241281.071468:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+26:2398:x1868815119978624:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 402us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241281.071476:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 54 00010000:00010000:2.0:1782241281.071501:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19af2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.071509:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19af2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782241281.071623:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1782241281.071736:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1782241281.071862:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f640380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1868815139991424:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782241281.071908:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241281.071943:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47ac1780 going to sleep for 11 seconds 00000100:00100000:3.0:1782241281.072021:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139991424 00000100:00100000:3.0:1782241281.072026:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139991424 00000100:00100000:3.0:1782241281.072159:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1782241281.072168:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1868815139991424:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782241281.072269:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1868815139991424:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 103us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241281.072286:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782241281.072359:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f640380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1868815139991424:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782241281.072514:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1782241281.072556:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477fa680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1868815139991552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782241281.072585:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782241281.072606:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241281.072633:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77963600 going to sleep for 11 seconds 00000100:00100000:3.0:1782241281.072715:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139991552 00000100:00100000:3.0:1782241281.072721:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139991552 00000100:00100000:3.0:1782241281.072826:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782241281.072834:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1868815139991552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782241281.072934:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6514:x1868815139991552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 100us (348us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1782241281.072939:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1782241281.072999:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477fa680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1868815139991552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782241281.073044:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1782241281.073089:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19af2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.073098:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19af2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.073105:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19af2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.073111:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241281.073115:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19af2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.073124:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19af2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.073137:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3600) 00010000:00010000:0.0:1782241281.073148:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1782241281.073154:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19af2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.073161:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19af2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782241281.073248:0:6514:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1782241281.073314:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1782241281.073325:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344331567191ns, next at 345331565263ns, rc = 0 00000001:00080000:0.0:1782241281.073330:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1782241281.073352:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3600) 00010000:00010000:0.0:1782241281.073355:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782241281.073362:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e19add lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505150 expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241281.073457:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4812bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+29:11159:x1868815119978496:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 9750us (10290us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1782241281.073466:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 8 00000020:00080000:0.0:1782241281.073470:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1782241281.076308:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241281.076407:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119978752 00000100:00100000:3.0:1782241281.076417:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119978752 00000100:00100000:3.0:1782241281.076597:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 54 00000100:00100000:3.0:1782241281.076607:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+29:11159:x1868815119978752:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241281.076630:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241281.076652:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19af9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505157 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.077068:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19af9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505157 expref: 30 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.077084:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19af9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505157 expref: 30 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.077105:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:3.0:1782241281.077108:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782241281.077112:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164de00, rc 0) 00000100:00100000:3.0:1782241281.077284:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+30:11159:x1868815119978752:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 678us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241281.077306:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 54 00000100:00100000:2.0:1782241281.081414:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241281.081492:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119979008 00000100:00100000:3.0:1782241281.081502:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119979008 00000100:00100000:2.0:1782241281.082160:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00100000:2.0:1782241281.082173:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47a4b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+30:11159:x1868815119979008:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:2.0:1782241281.082617:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47a4b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+31:11159:x1868815119979008:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 446us (1210us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1782241281.082626:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00100000:0.0:1782241281.189136:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241281.189511:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119979264 00000100:00100000:1.0:1782241281.189522:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119979264 00000100:00100000:1.0:1782241281.189580:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 55 00000100:00100000:1.0:1782241281.189591:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+31:11169:x1868815119979264:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241281.189616:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241281.189802:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19b00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350515e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241281.189912:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1782241281.190026:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19b00 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350515e expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.190041:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b500) 00010000:00010000:1.0:1782241281.190058:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782241281.190064:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19b00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350515e expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.190078:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb400, rc 0) 00000100:00100000:1.0:1782241281.190237:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+32:11169:x1868815119979264:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 647us (1110us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1782241281.190245:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 55 00000100:00100000:0.0:1782241281.210068:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241281.210296:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119979392 00000100:00100000:3.0:1782241281.210308:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119979392 00000100:00100000:3.0:1782241281.210379:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 56 00000100:00100000:3.0:1782241281.210390:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+32:11169:x1868815119979392:12345-192.168.204.58@tcp:34:lfs.0 00010000:00010000:3.0:1782241281.210478:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b0e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.210494:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.210506:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.210518:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.210525:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.210531:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.210602:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19b1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.210610:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.210631:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782241281.210683:0:11191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.210696:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.210702:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b0e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.210708:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.210713:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241281.210718:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.210724:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b0e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.210735:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:3.0:1782241281.210738:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241281.210742:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.210747:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.211037:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.211051:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.211057:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.211062:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241281.211065:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.211072:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.211080:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890e528b3300) 00010000:00010000:3.0:1782241281.211083:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241281.211086:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.211091:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.211101:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.211106:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19b1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.211112:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19b1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.211117:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164da00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241281.211126:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19b1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.211133:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19b1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.211141:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:3.0:1782241281.211143:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241281.211146:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19b1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.211152:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19b1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241281.211626:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+32:11169:x1868815119979392:12345-192.168.204.58@tcp:34:lfs.0 Request processed in 1235us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241281.211635:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 56 00000100:00100000:2.0:1782241281.216332:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241281.216480:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119979648 00000100:00100000:0.0:1782241281.216491:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119979648 00000100:00100000:0.0:1782241281.216543:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00100000:0.0:1782241281.216553:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+32:11169:x1868815119979648:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:0.0:1782241281.217204:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+33:11169:x1868815119979648:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 649us (877us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1782241281.217228:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00100000:0.0:1782241281.270121:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241281.270411:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119979904 00000100:00100000:3.0:1782241281.270421:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119979904 00000100:00100000:3.0:1782241281.270495:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 57 00000100:00100000:3.0:1782241281.270505:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+33:11172:x1868815119979904:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241281.270529:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241281.270548:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19b23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505165 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.270619:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b2a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.270634:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b2a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.270667:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b2a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.270681:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.270688:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241281.270695:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.271519:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19b38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.271533:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19b38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.271541:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19b38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241281.271561:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1782241281.271648:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b2a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.271655:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b2a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.271661:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b2a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.271666:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241281.271671:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b2a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.271678:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b2a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.271690:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:2.0:1782241281.271694:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241281.271698:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b2a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.271704:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e19b2a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.271717:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.271974:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b31 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.271993:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.271999:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241281.272001:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.272900:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.272912:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890e528b3300) 00010000:00010000:2.0:1782241281.272914:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241281.272918:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b31 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.272924:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19b31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.272979:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19b23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505165 expref: 36 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.272994:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19b38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505165 expref: 35 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.273001:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241281.273014:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241281.273017:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad600, rc 0) 00000100:00100000:2.0:1782241281.273145:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+35:11172:x1868815119979904:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 2640us (3033us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1782241281.273166:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 57 00000100:00100000:2.0:1782241281.280091:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241281.280214:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119980032 00000100:00100000:1.0:1782241281.280224:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119980032 00000100:00100000:1.0:1782241281.280287:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 58 00000100:00100000:1.0:1782241281.280297:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+35:11172:x1868815119980032:12345-192.168.204.58@tcp:54:lfs.0 00010000:00010000:1.0:1782241281.280366:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19b46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.280389:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19b46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.280401:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19b46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.280444:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19b46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.280451:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19b46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.280457:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19b46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.280463:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241281.280481:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19b46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.280488:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19b46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.280500:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241281.280503:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782241281.280508:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19b46 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.280514:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19b46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241281.280595:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+35:11172:x1868815119980032:12345-192.168.204.58@tcp:54:lfs.0 Request processed in 299us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241281.280604:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 58 00000100:00100000:0.0:1782241281.286021:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241281.286043:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139991680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241281.286112:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241281.286220:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139991680 00000100:00100000:0.0:1782241281.286228:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139991680 00000100:00100000:0.0:1782241281.286295:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1782241281.286306:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139991680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782241281.286336:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241281.286388:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139991680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241281.286395:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1782241281.286416:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782241281.288901:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139991680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241281.289372:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e48128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139991936:0@lo:400:kworker.0 00000100:00100000:3.0:1782241281.289439:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241281.289477:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e48128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815139992448:0@lo:400:kworker.0 00000100:00100000:3.0:1782241281.289504:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241281.289533:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e51ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815139992960:0@lo:400:kworker.0 00000100:00100000:2.0:1782241281.289556:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139991936 00000100:00100000:3.0:1782241281.289559:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241281.289564:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139991936 00000100:00100000:3.0:1782241281.289590:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1782241281.289599:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e4812aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139991808:0@lo:400:kworker.0 00000100:00100000:2.0:1782241281.289611:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139992448 00000100:00100000:2.0:1782241281.289616:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139992448 00000100:00100000:3.0:1782241281.289634:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241281.289653:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139992960 00000100:00100000:2.0:1782241281.289658:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139992960 00000100:00100000:3.0:1782241281.289665:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e4812bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139992320:0@lo:400:kworker.0 00000100:00100000:2.0:1782241281.289689:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1782241281.289697:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241281.289703:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139991936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241281.289719:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e51ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815139992832:0@lo:400:kworker.0 00000100:00100000:3.0:1782241281.289792:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241281.289869:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139992832 00000100:00100000:1.0:1782241281.289879:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139992832 00000100:00100000:1.0:1782241281.289906:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1782241281.289914:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815139992448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241281.289994:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e48129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139992064:0@lo:400:kworker.0 00000100:00100000:2.0:1782241281.290069:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815139991936:12345-0@lo:400:kworker.0 Request processed in 370us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241281.290078:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1782241281.290097:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1782241281.290104:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815139992960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241281.290140:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815139992960:12345-0@lo:400:kworker.0 Request processed in 37us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241281.290146:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1782241281.290158:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1782241281.290164:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815139992832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241281.290196:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815139992832:12345-0@lo:400:kworker.0 Request processed in 31us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241281.290201:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:2.0:1782241281.290218:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241281.290222:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241281.292044:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815139992448:12345-0@lo:400:kworker.0 Request processed in 2123us (2529us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241281.292058:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1782241281.292176:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241281.292201:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139991808 00000100:00100000:2.0:1782241281.292222:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139991808 00000100:00100000:2.0:1782241281.292337:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1782241281.292347:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139991808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241281.292426:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815139991808:12345-0@lo:400:kworker.0 Request processed in 81us (2792us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241281.292432:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1782241281.292470:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e48129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139992192:0@lo:400:kworker.0 00000100:00100000:2.0:1782241281.292608:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241281.292642:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e51ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139992704:0@lo:400:kworker.0 00000100:00100000:2.0:1782241281.292669:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241281.292712:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139992192 00000100:00100000:2.0:1782241281.292716:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139992192 00000100:00100000:2.0:1782241281.292741:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1782241281.292748:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139992192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241281.292809:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815139992192:12345-0@lo:400:kworker.0 Request processed in 62us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241281.292816:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1782241281.292923:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e48129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815139992192:0@lo:400:kworker.0 00000100:00100000:1.0:1782241281.293090:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139992320 00000100:00100000:1.0:1782241281.293096:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139992320 00000100:00100000:1.0:1782241281.293125:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1782241281.293134:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139992320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241281.293141:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119980288 00000100:00100000:2.0:1782241281.293146:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119980288 00000100:00100000:1.0:1782241281.293180:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815139992320:12345-0@lo:400:kworker.0 Request processed in 46us (3482us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241281.293185:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:2.0:1782241281.293193:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+35:11172:x1868815119980288:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:1.0:1782241281.293276:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782241281.293372:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139992704 00000100:00100000:3.0:1782241281.293383:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139992704 00000100:00100000:2.0:1782241281.293406:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+36:11172:x1868815119980288:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 213us (1231us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1782241281.293415:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:3.0:1782241281.293498:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782241281.293506:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139992704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241281.293555:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815139992704:12345-0@lo:400:kworker.0 Request processed in 49us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241281.293561:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782241281.293614:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e51ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815139992832:0@lo:400:kworker.0 00000100:00100000:3.0:1782241281.293628:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e48128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815139991936:0@lo:400:kworker.0 00000100:00100000:3.0:1782241281.293639:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e48128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815139992448:0@lo:400:kworker.0 00010000:00080000:3.0:1782241281.293655:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e51ae1880 x1868815139992960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241281.293667:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e51ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815139992704:0@lo:400:kworker.0 00000100:00100000:3.0:1782241281.293668:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e51ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815139992960:0@lo:400:kworker.0 00000100:00100000:3.0:1782241281.293705:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e4812aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815139991808:0@lo:400:kworker.0 00000100:00100000:3.0:1782241281.293715:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e4812bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139992320:0@lo:400:kworker.0 00000100:00080000:1.0:1782241281.294366:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241281.295753:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241281.295834:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e51ae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139992576:0@lo:400:kworker.0 00000100:00100000:0.0:1782241281.295875:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241281.295895:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e51ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139993088:0@lo:400:kworker.0 00000100:00100000:0.0:1782241281.295920:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241281.295960:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139993088 00000100:00100000:0.0:1782241281.295966:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139993088 00000100:00100000:2.0:1782241281.296350:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139992576 00000100:00100000:2.0:1782241281.296356:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139992576 00000100:00100000:2.0:1782241281.296398:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1782241281.296406:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139992576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241281.296475:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815139992576:12345-0@lo:400:kworker.0 Request processed in 69us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241281.296482:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1782241281.296634:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782241281.296643:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139993088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241281.296675:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139992064 00000100:00100000:3.0:1782241281.296682:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139992064 00000100:00100000:0.0:1782241281.296699:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139993088:12345-0@lo:400:kworker.0 Request processed in 57us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241281.296708:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1782241281.296831:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241281.296836:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782241281.296849:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e51ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139993088:0@lo:400:kworker.0 00010000:00080000:1.0:1782241281.296885:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e51ae3b80 x1868815139992576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241281.296896:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e51ae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815139992576:0@lo:400:kworker.0 00000100:00100000:3.0:1782241281.297025:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782241281.297034:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139992064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241281.297080:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815139992064:12345-0@lo:400:kworker.0 Request processed in 49us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241281.297086:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1782241281.297139:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e48129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815139992064:0@lo:400:kworker.0 00000100:00100000:3.0:1782241281.609976:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241281.616217:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119980544 00000100:00100000:2.0:1782241281.616232:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119980544 00000100:00100000:2.0:1782241281.616459:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 59 00000100:00100000:2.0:1782241281.616469:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+36:11203:x1868815119980544:12345-192.168.204.58@tcp:101:cat.0 00010000:00010000:2.0:1782241281.616492:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241281.616511:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19b4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350516c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.616615:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19b54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.616638:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19b54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.616648:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19b54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241281.616665:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1782241281.616795:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19b4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350516c expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.616830:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19b54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350516c expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.616838:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241281.616841:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241281.616844:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fac200, rc 0) 00000100:00100000:2.0:1782241281.616906:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+38:11203:x1868815119980544:12345-192.168.204.58@tcp:101:cat.0 Request processed in 438us (6939us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1782241281.616914:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 59 00000100:00100000:1.0:1782241281.622962:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241281.623160:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119980800 00000100:00100000:0.0:1782241281.623172:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119980800 00000100:00100000:0.0:1782241281.623244:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:0.0:1782241281.623257:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+38:11203:x1868815119980800:12345-192.168.204.58@tcp:35:cat.0 00000100:00100000:3.0:1782241281.623283:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241281.623541:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+39:11203:x1868815119980800:12345-192.168.204.58@tcp:35:cat.0 Request processed in 285us (587us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1782241281.623551:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:1.0:1782241281.623915:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119980928 00000100:00100000:1.0:1782241281.623921:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119980928 00000100:00100000:1.0:1782241281.623971:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 4 00000100:00100000:1.0:1782241281.623980:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+39:2397:x1868815119980928:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241281.623991:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241281.624035:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19b54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350516c expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.624056:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241281.624061:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241281.624156:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+38:2397:x1868815119980928:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 175us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241281.624169:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 4 00010000:00010000:3.0:1782241281.669010:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241281.724797:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241281.724939:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119981184 00000100:00100000:2.0:1782241281.724948:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119981184 00000100:00100000:2.0:1782241281.727130:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 60 00000100:00100000:2.0:1782241281.727164:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+38:11209:x1868815119981184:12345-192.168.204.58@tcp:101:dd.0 00010000:00010000:2.0:1782241281.727190:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241281.727193:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782241281.727325:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19aba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505142 expref: 38 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.727344:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:2.0:1782241281.727349:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241281.727426:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19b62 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505173 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.727647:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e19b69 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.727682:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19b38 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505165 expref: 38 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.727691:0:11191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e19b69 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.727726:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19b38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505165 expref: 38 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.727740:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19b38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505165 expref: 38 pid: 10147 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241281.727754:0:11191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e48129880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11191:1868815139993216:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241281.729159:0:11191:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47ac1180 going to sleep for 11 seconds 00000100:00100000:3.0:1782241281.739386:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241281.739557:0:11191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e48129880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11191:1868815139993216:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241281.739584:0:11191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e19b69 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241281.739669:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119981312 00000100:00100000:1.0:1782241281.739677:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119981312 00010000:00010000:1.0:1782241281.739711:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19b38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505165 expref: 39 pid: 10147 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241281.739804:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 55 00000100:00100000:1.0:1782241281.739813:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+39:2398:x1868815119981312:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241281.739829:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241281.739837:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19b38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505165 expref: 39 pid: 10147 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.739849:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19b38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505165 expref: 39 pid: 10147 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.739871:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19b38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505165 expref: 39 pid: 10147 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.739887:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241281.739892:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e19b69 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.739901:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e19b69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.739909:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e19b69 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241281.739937:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241281.739992:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+38:2398:x1868815119981312:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 179us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241281.740011:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 55 00010000:00010000:2.0:1782241281.740072:0:11191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e19b69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.740079:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e19b69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241281.740099:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1782241281.740259:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19b62 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505173 expref: 39 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.740287:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e19b69 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505173 expref: 38 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.740295:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241281.740297:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782241281.740299:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43faca00, rc 0) 00000100:00100000:2.0:1782241281.740326:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+38:11209:x1868815119981184:12345-192.168.204.58@tcp:101:dd.0 Request processed in 13181us (15540us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1782241281.740334:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 60 00000100:00100000:3.0:1782241281.744102:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241281.744199:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119981440 00000100:00100000:0.0:1782241281.744208:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119981440 00000100:00100000:0.0:1782241281.744265:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 61 00000100:00100000:0.0:1782241281.744274:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+38:11209:x1868815119981440:12345-192.168.204.58@tcp:101:dd.0 00010000:00010000:0.0:1782241281.744295:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241281.744314:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19b77 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350517a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.744352:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19b7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.744366:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19b7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.744379:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19b7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.744516:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19b77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350517a expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.744535:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19b7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350517a expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241281.744544:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241281.744547:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782241281.744550:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0e00, rc 0) 00000100:00100000:0.0:1782241281.744614:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+39:11209:x1868815119981440:12345-192.168.204.58@tcp:101:dd.0 Request processed in 340us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241281.744622:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 61 00000100:00100000:3.0:1782241281.756394:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241281.756498:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119981696 00000100:00100000:2.0:1782241281.756509:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119981696 00000100:00100000:2.0:1782241281.756572:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 62 00000100:00100000:2.0:1782241281.756583:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+39:11209:x1868815119981696:12345-192.168.204.58@tcp:36:dd.0 00010000:00010000:2.0:1782241281.756868:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19b85 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.756885:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19b85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.756896:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19b85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782241281.756942:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1782241281.756964:0:6511:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000080f51423 reply state 000000002a940644 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19b85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.756977:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19b85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241281.757014:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241281.757017:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782241281.757187:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782241281.757282:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+42:11209:x1868815119981696:12345-192.168.204.58@tcp:36:dd.0 Request processed in 699us (896us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1782241281.757289:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 62 00000020:00080000:2.0:1782241281.757295:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1782241281.797424:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241281.797450:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139993344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241281.797528:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241281.797788:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139993472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241281.797819:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241281.798317:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139993472 00000100:00100000:0.0:1782241281.798327:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139993472 00000100:00100000:0.0:1782241281.798381:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782241281.798390:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e48129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139993472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241281.798413:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241281.798490:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e48129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139993472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241281.798497:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1782241281.798586:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139993472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241281.798692:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139993344 00000100:00100000:1.0:1782241281.798709:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139993344 00000100:00100000:1.0:1782241281.798745:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1782241281.798752:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139993344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241281.798808:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241281.798862:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139993344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241281.798869:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782241281.799151:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139993344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241282.031283:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241282.031453:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119981824 00000100:00100000:2.0:1782241282.031464:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119981824 00000100:00100000:2.0:1782241282.031545:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 63 00000100:00100000:2.0:1782241282.031556:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+42:11224:x1868815119981824:12345-192.168.204.58@tcp:101:stat.0 00010000:00010000:2.0:1782241282.031579:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241282.031599:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19b8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505181 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.031662:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19b93 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.031677:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19b93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.031686:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19b93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.031697:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19b9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.031718:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19b9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.031725:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19b9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782241282.031901:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782241282.031983:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19ba1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.032078:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e19b69 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505173 expref: 43 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.032087:0:11191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19ba1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.032121:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e19b69 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505173 expref: 43 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.032135:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e19b69 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505173 expref: 43 pid: 11191 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241282.032148:0:11191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e4812bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11191:1868815139993600:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241282.032300:0:11191:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47ac1180 going to sleep for 11 seconds 00000100:00100000:3.0:1782241282.043434:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241282.043568:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119982080 00000100:00100000:0.0:1782241282.043577:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119982080 00000100:00100000:0.0:1782241282.043639:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:0.0:1782241282.043648:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+44:6166:x1868815119982080:12345-192.168.204.58@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782241282.043952:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+45:6166:x1868815119982080:12345-192.168.204.58@tcp:35:ldlm_bl.0 Request processed in 304us (526us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1782241282.043972:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:2.0:1782241282.044486:0:11191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e4812bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11191:1868815139993600:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241282.044513:0:11191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19ba1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241282.046542:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241282.046689:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119982208 00000100:00100000:1.0:1782241282.046698:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119982208 00010000:00010000:1.0:1782241282.046733:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e19b69 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505173 expref: 45 pid: 11191 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241282.046800:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 56 00000100:00100000:1.0:1782241282.046809:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+45:2398:x1868815119982208:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241282.046824:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241282.046831:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e19b69 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505173 expref: 45 pid: 11191 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.046843:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e19b69 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505173 expref: 45 pid: 11191 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.046865:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e19b69 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505173 expref: 45 pid: 11191 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.046879:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241282.046884:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19ba1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.046908:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.046915:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19ba1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.046947:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241282.047016:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+44:2398:x1868815119982208:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 206us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241282.047023:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 56 00010000:00010000:2.0:1782241282.047350:0:11191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047364:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241282.047423:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1782241282.047430:0:11191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782241282.047482:0:11191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047496:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047506:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19b93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047512:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19b93 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047519:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19b93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047525:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241282.047530:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19b93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047537:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19b93 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047546:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:2.0:1782241282.047549:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241282.047553:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19b93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047570:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19b93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047584:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19b9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047590:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19b9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047596:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19b9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047601:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241282.047604:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19b9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047610:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19b9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047618:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890e528b3300) 00010000:00010000:2.0:1782241282.047621:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241282.047624:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19b9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047630:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19b9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047661:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19b8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505181 expref: 44 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047686:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505181 expref: 43 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.047692:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241282.047694:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241282.047696:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fade00, rc 0) 00000100:00100000:2.0:1782241282.047740:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+43:11224:x1868815119981824:12345-192.168.204.58@tcp:101:stat.0 Request processed in 16186us (16468us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241282.047748:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 63 00000100:00100000:3.0:1782241282.111427:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241282.111587:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119982464 00000100:00100000:2.0:1782241282.111598:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119982464 00000100:00100000:2.0:1782241282.111658:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 64 00000100:00100000:2.0:1782241282.111668:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+43:11230:x1868815119982464:12345-192.168.204.58@tcp:36:truncate.0 00010000:00010000:2.0:1782241282.111736:0:10147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241282.111788:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19ba1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505181 expref: 43 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.111809:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241282.111813:0:10147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241282.111985:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19ba8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.112011:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.112022:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782241282.112082:0:10147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1782241282.112103:0:10147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f7bdcc46 reply state 00000000cca34ab0 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.112115:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19ba8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.112122:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241282.112125:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782241282.112128:0:10147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782241282.112423:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+45:11230:x1868815119982464:12345-192.168.204.58@tcp:36:truncate.0 Request processed in 754us (1005us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1782241282.112430:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 64 00000020:00080000:2.0:1782241282.112437:0:10147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782241282.231721:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241282.231888:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119982592 00000100:00100000:2.0:1782241282.231899:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119982592 00000100:00100000:2.0:1782241282.231964:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 65 00000100:00100000:2.0:1782241282.231974:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+45:11244:x1868815119982592:12345-192.168.204.58@tcp:101:stat.0 00010000:00010000:2.0:1782241282.232008:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241282.232030:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19baf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505188 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232104:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bb6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232119:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232131:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232158:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19bbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232166:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19bbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232172:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19bbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232249:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19bc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232259:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232267:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241282.232312:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1782241282.232317:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782241282.232336:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232350:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232358:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232365:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bb6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232382:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232389:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241282.232393:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232400:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bb6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232413:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:2.0:1782241282.232416:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241282.232421:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bb6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232428:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bb6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232441:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19bbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232448:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19bbd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232454:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19bbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232459:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241282.232461:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19bbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232477:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19bbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232486:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890e528b3300) 00010000:00010000:2.0:1782241282.232489:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241282.232492:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19bbd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232497:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19bbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232522:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19baf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505188 expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232535:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505188 expref: 46 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.232543:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241282.232545:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241282.232548:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fac600, rc 0) 00000100:00100000:2.0:1782241282.232610:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+46:11244:x1868815119982592:12345-192.168.204.58@tcp:101:stat.0 Request processed in 638us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241282.232619:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 65 00000100:00100000:0.0:1782241282.345539:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241282.346547:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119982848 00000100:00100000:2.0:1782241282.346563:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119982848 00000100:00100000:2.0:1782241282.346896:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 66 00000100:00100000:2.0:1782241282.346909:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+46:11254:x1868815119982848:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241282.346960:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241282.347000:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19bcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350518f expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241282.347902:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1782241282.348570:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19bcb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350518f expref: 48 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.348808:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b500) 00010000:00010000:2.0:1782241282.348813:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782241282.348820:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19bcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350518f expref: 48 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.348839:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fade00, rc 0) 00000100:00100000:2.0:1782241282.349018:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+47:11254:x1868815119982848:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 2111us (3620us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1782241282.349031:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 66 00000100:00100000:3.0:1782241282.355619:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241282.357281:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119983104 00000100:00100000:0.0:1782241282.357303:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119983104 00000100:00100000:0.0:1782241282.357383:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 14 00000100:00100000:0.0:1782241282.357396:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+47:11254:x1868815119983104:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:0.0:1782241282.359055:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+48:11254:x1868815119983104:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 1648us (4774us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1782241282.359070:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 14 00000100:00100000:1.0:1782241282.448328:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241282.449111:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119983360 00000100:00100000:2.0:1782241282.449126:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119983360 00000100:00100000:2.0:1782241282.449226:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 67 00000100:00100000:2.0:1782241282.449239:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+48:11260:x1868815119983360:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:2.0:1782241282.449275:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241282.449303:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19bd9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505196 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.449454:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19be0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.449497:0:10147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19bc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505188 expref: 49 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.449508:0:10147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19be0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.449551:0:10147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505188 expref: 49 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.449567:0:10147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19bc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505188 expref: 49 pid: 6511 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241282.449583:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e4812bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815139993728:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241282.450061:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47ac1480 going to sleep for 11 seconds 00000100:00100000:2.0:1782241282.472095:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e4812bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815139993728:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241282.472145:0:10147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19be0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241282.473508:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241282.473816:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119983488 00000100:00100000:1.0:1782241282.473829:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119983488 00010000:00010000:1.0:1782241282.473888:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19bc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505188 expref: 50 pid: 6511 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241282.473950:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 57 00000100:00100000:1.0:1782241282.473962:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e477c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+50:2398:x1868815119983488:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241282.473997:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241282.474005:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19bc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505188 expref: 50 pid: 6511 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.474225:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505188 expref: 50 pid: 6511 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.474265:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19bc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505188 expref: 50 pid: 6511 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.474304:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241282.474310:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19be0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.474322:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19be0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.474340:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19be0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.474380:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241282.474570:0:10147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19be0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.474580:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19be0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241282.474606:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000100:00100000:1.0:1782241282.474710:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e477c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+50:2398:x1868815119983488:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 749us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241282.474720:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 57 00010000:00010000:2.0:1782241282.477568:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19bd9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505196 expref: 50 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.477642:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19be0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505196 expref: 49 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.477653:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241282.477657:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782241282.477661:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad400, rc 0) 00000100:00100000:2.0:1782241282.477856:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+49:11260:x1868815119983360:12345-192.168.204.58@tcp:101:bash.0 Request processed in 28618us (29542us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1782241282.477876:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 67 00000100:00100000:2.0:1782241282.490623:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241282.490745:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119983744 00000100:00100000:1.0:1782241282.490796:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119983744 00000100:00100000:1.0:1782241282.491213:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 68 00000100:00100000:1.0:1782241282.491225:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4812bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+49:11260:x1868815119983744:12345-192.168.204.58@tcp:36:bash.0 00010000:00010000:1.0:1782241282.491556:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19bee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.491579:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19bee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.491593:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19bee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782241282.491651:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1782241282.491676:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fbebf0b7 reply state 000000000c381a93 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19bee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.491709:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19bee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.491719:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241282.491722:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782241282.491726:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782241282.492063:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4812bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+52:11260:x1868815119983744:12345-192.168.204.58@tcp:36:bash.0 Request processed in 837us (1452us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1782241282.492073:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 68 00000020:00080000:1.0:1782241282.492079:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782241282.504030:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241282.504312:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119983872 00000100:00100000:2.0:1782241282.504326:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119983872 00000100:00100000:2.0:1782241282.504520:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 69 00000100:00100000:2.0:1782241282.504534:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+52:11260:x1868815119983872:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:2.0:1782241282.504571:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241282.504601:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19bf5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350519d expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.504722:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.504741:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19be0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505196 expref: 53 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.504750:0:11191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bfc lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.504876:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19be0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505196 expref: 53 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.504893:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19be0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505196 expref: 53 pid: 10147 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241282.504911:0:11191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e4812aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11191:1868815139993856:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241282.506486:0:11191:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47ac1480 going to sleep for 11 seconds 00000100:00100000:3.0:1782241282.518667:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241282.518818:0:11191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e4812aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11191:1868815139993856:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241282.518865:0:11191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241282.519298:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119984000 00000100:00100000:0.0:1782241282.519309:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119984000 00010000:00010000:0.0:1782241282.519362:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19be0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505196 expref: 54 pid: 10147 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241282.519518:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 58 00000100:00100000:0.0:1782241282.519532:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+54:2399:x1868815119984000:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241282.519554:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241282.519562:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19be0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505196 expref: 54 pid: 10147 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.519577:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19be0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505196 expref: 54 pid: 10147 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.519605:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19be0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505196 expref: 54 pid: 10147 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.519660:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241282.519666:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.519678:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.519688:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bfc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.519728:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782241282.519824:0:11191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241282.519834:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241282.519846:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+53:2399:x1868815119984000:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 316us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241282.519856:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 58 00000004:00200000:3.0:1782241282.519940:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1782241282.519948:0:11191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782241282.520868:0:11191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.520924:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19bf5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350519d expref: 53 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.520947:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350519d expref: 52 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.520956:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241282.520958:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241282.520962:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad200, rc 0) 00000100:00100000:2.0:1782241282.522352:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+52:11260:x1868815119983872:12345-192.168.204.58@tcp:101:bash.0 Request processed in 16507us (17023us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241282.522373:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 69 00000100:00100000:3.0:1782241282.525043:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241282.525844:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119984256 00000100:00100000:1.0:1782241282.525861:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119984256 00000100:00100000:1.0:1782241282.525951:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00100000:1.0:1782241282.525965:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47a49050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+52:11260:x1868815119984256:12345-192.168.204.58@tcp:35:bash.0 00000100:00100000:1.0:1782241282.526928:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47a49050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+53:11260:x1868815119984256:12345-192.168.204.58@tcp:35:bash.0 Request processed in 956us (1890us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1782241282.526941:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00100000:1.0:1782241282.632793:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241282.632973:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119984512 00000100:00100000:2.0:1782241282.632996:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119984512 00000100:00100000:2.0:1782241282.633223:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 70 00000100:00100000:2.0:1782241282.633245:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e778dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+53:11270:x1868815119984512:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241282.633299:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241282.633326:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19c03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335051a4 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241282.633471:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1782241282.633607:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19c03 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051a4 expref: 55 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.633625:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b500) 00010000:00010000:2.0:1782241282.633629:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782241282.633635:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19c03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051a4 expref: 55 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.633652:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fade00, rc 0) 00000100:00100000:2.0:1782241282.633729:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e778dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+54:11270:x1868815119984512:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 495us (984us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1782241282.633737:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 70 00000100:00100000:3.0:1782241282.636231:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241282.636401:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119984640 00000100:00100000:1.0:1782241282.636413:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119984640 00000100:00100000:1.0:1782241282.636492:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 71 00000100:00100000:1.0:1782241282.636520:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+54:11270:x1868815119984640:12345-192.168.204.58@tcp:34:lfs.0 00010000:00010000:1.0:1782241282.636704:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c11 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.636727:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c11 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.636742:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c11 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.636805:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.636814:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.636822:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.636936:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.636946:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.636954:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782241282.637030:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.637045:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c11 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.637060:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c11 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.637067:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c11 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.637075:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eae00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241282.637081:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c11 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.637090:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c11 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.637104:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:1.0:1782241282.637107:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241282.637114:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c11 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.637121:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c11 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.637137:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.637144:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.637149:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.637154:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241282.637727:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.637737:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.637748:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890e528b3300) 00010000:00010000:1.0:1782241282.637751:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241282.637754:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c18 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.638264:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.638281:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.638288:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c1f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.638295:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.638300:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241282.638303:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.638309:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.638320:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241282.638323:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241282.638336:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c1f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.638342:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241282.638503:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+54:11270:x1868815119984640:12345-192.168.204.58@tcp:34:lfs.0 Request processed in 1979us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241282.638515:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 71 00000100:00100000:3.0:1782241282.647502:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241282.649037:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119984896 00000100:00100000:1.0:1782241282.649057:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119984896 00000100:00100000:1.0:1782241282.650885:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 16 00000100:00100000:1.0:1782241282.650914:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+54:11270:x1868815119984896:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:1.0:1782241282.651333:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+55:11270:x1868815119984896:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 430us (3844us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1782241282.651343:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 16 00010000:00010000:0.0:1782241282.693541:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241282.699133:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241282.700799:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119985152 00000100:00100000:1.0:1782241282.700819:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119985152 00000100:00100000:1.0:1782241282.701152:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 72 00000100:00100000:1.0:1782241282.701175:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e48128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+55:11273:x1868815119985152:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241282.701219:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241282.701253:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c26 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335051ab expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701356:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c2d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701373:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701410:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701424:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701433:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701439:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701586:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e19c3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701597:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e19c3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701604:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e19c3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241282.701617:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782241282.701713:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701719:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c2d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701726:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701733:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241282.701743:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701752:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c2d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701807:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:1.0:1782241282.701811:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241282.701817:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c2d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701824:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19c2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701842:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701848:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701854:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701860:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eae00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241282.701874:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701880:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701888:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890e528b3300) 00010000:00010000:1.0:1782241282.701890:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241282.701900:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c34 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701906:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19c34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701952:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ab expref: 58 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701966:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e19c3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ab expref: 57 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.701973:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241282.701985:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241282.701987:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb600, rc 0) 00000100:00100000:1.0:1782241282.702086:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e48128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+57:11273:x1868815119985152:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 914us (2967us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1782241282.707064:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241282.707180:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241282.710746:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119985280 00000100:00100000:3.0:1782241282.710817:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119985280 00000100:00100000:3.0:1782241282.710922:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:3.0:1782241282.710934:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+58:2397:x1868815119985280:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241282.710956:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241282.711002:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e19c3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ab expref: 58 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241282.711025:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:3.0:1782241282.711031:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241282.711118:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+57:2397:x1868815119985280:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 186us (3937us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241282.711126:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:0.0:1782241282.712664:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119985408 00000100:00100000:0.0:1782241282.712679:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119985408 00000100:00100000:1.0:1782241282.713045:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 72 00000100:00100000:1.0:1782241282.713089:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 73 00000100:00100000:1.0:1782241282.713102:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+56:11273:x1868815119985408:12345-192.168.204.58@tcp:54:lfs.0 00010000:00010000:1.0:1782241282.713214:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19c49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.713244:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.713258:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.713312:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.713338:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19c49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.713346:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19c49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.713352:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241282.713358:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19c49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.713366:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19c49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.713381:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241282.713384:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782241282.713389:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19c49 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.713395:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19c49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241282.713487:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+56:11273:x1868815119985408:12345-192.168.204.58@tcp:54:lfs.0 Request processed in 387us (6447us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241282.713495:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 73 00000100:00100000:3.0:1782241282.716580:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241282.716676:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119985664 00000100:00100000:0.0:1782241282.716690:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119985664 00000100:00100000:0.0:1782241282.716784:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:0.0:1782241282.716797:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+56:11273:x1868815119985664:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:0.0:1782241282.717401:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+57:11273:x1868815119985664:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 604us (833us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1782241282.717410:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:3.0:1782241282.880002:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241282.880361:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119985920 00000100:00100000:1.0:1782241282.880374:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119985920 00000100:00100000:1.0:1782241282.880559:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 74 00000100:00100000:1.0:1782241282.880571:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+57:11291:x1868815119985920:12345-192.168.204.58@tcp:101:cat.0 00010000:00010000:1.0:1782241282.880608:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241282.880648:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19c50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335051b2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.880859:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c57 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.880879:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.880896:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241282.880910:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782241282.881738:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19c50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051b2 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.881809:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051b2 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.881833:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241282.881837:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782241282.881842:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea800, rc 0) 00000100:00100000:1.0:1782241282.882071:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:11291:x1868815119985920:12345-192.168.204.58@tcp:101:cat.0 Request processed in 1501us (2313us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1782241282.882094:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 74 00000100:00100000:3.0:1782241282.912949:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241282.913366:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119986048 00000100:00100000:0.0:1782241282.913385:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119986048 00000100:00100000:0.0:1782241282.913488:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 75 00000100:00100000:0.0:1782241282.913500:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:11292:x1868815119986048:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241282.913561:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241282.913597:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19c65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335051b9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.913688:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19c6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.913706:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19c6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.913719:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19c6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241282.913841:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1782241282.913846:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241282.913871:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19c6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.913902:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19c65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051b9 expref: 61 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.913927:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19c6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051b9 expref: 60 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.913937:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:0.0:1782241282.913940:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782241282.913945:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1200, rc 0) 00000100:00100000:0.0:1782241282.914049:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:11292:x1868815119986048:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 550us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241282.914057:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 75 00000100:00100000:3.0:1782241282.922614:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241282.922730:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119986432 00000100:00100000:1.0:1782241282.922744:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119986432 00000100:00100000:1.0:1782241282.922853:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:1.0:1782241282.922864:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:11292:x1868815119986432:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:1.0:1782241282.923643:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+61:11292:x1868815119986432:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 774us (1037us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1782241282.923656:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:3.0:1782241282.927123:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241282.927223:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119986560 00000100:00100000:1.0:1782241282.927237:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119986560 00000100:00100000:1.0:1782241282.927332:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 6 00000100:00100000:1.0:1782241282.927346:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+61:11292:x1868815119986560:12345-192.168.204.58@tcp:103:lfs.0 00010000:00010000:1.0:1782241282.927368:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782241282.927414:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19bfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350519d expref: 61 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.927443:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19c57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051b2 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.927457:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19af9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505157 expref: 59 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241282.927470:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241282.927476:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241282.928536:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+58:11292:x1868815119986560:12345-192.168.204.58@tcp:103:lfs.0 Request processed in 1182us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241282.928552:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 6 00000100:00100000:3.0:1782241282.931979:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241282.932265:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119986688 00000100:00100000:2.0:1782241282.932279:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119986688 00000100:00100000:2.0:1782241282.932365:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 76 00000100:00100000:2.0:1782241282.932378:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+58:11292:x1868815119986688:12345-192.168.204.58@tcp:58:lfs.0 00010000:00010000:2.0:1782241282.932577:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19c73 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.932599:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19c73 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241282.932626:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19c73 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782241282.933882:0:10147:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782241282.934347:0:10147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1782241282.934458:0:10147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1782241282.934602:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+58:11292:x1868815119986688:12345-192.168.204.58@tcp:58:lfs.0 Request processed in 2221us (2643us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241282.934617:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 76 00000100:00100000:2.0:1782241282.951935:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241282.952375:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119986816 00000100:00100000:1.0:1782241282.952388:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119986816 00000100:00100000:0.0:1782241282.952537:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 77 00000100:00100000:0.0:1782241282.952549:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e48128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+58:11294:x1868815119986816:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241282.952579:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241282.952606:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e19c7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335051c0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.952695:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19c81 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.952714:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19c81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.952726:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19c81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.952810:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19c88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.952901:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19c88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.952910:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19c88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953033:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19c8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953043:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19c8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953051:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19c8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241282.953202:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1782241282.953208:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241282.953233:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19c8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953247:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19c8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953257:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19c81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953263:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19c81 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953270:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19c81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953277:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241282.953282:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19c81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953290:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19c81 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953305:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:0.0:1782241282.953308:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241282.953314:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19c81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953321:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19c81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953348:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19c88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953355:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19c88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953361:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19c88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953367:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241282.953370:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19c88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953377:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19c88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953387:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890e528b3300) 00010000:00010000:0.0:1782241282.953390:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241282.953516:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19c88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953525:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19c88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953563:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e19c7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051c0 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953578:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19c8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051c0 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241282.953597:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241282.953600:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782241282.953602:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0200, rc 0) 00000100:00100000:0.0:1782241282.953877:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e48128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:11294:x1868815119986816:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 1328us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241282.953887:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 77 00000040:00080000:3.0:1782241283.141789:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782241283.141805:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782241283.141864:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782241283.141875:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782241283.142076:0:13782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1868815139993984:192.168.204.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782241283.142229:0:13782:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d46869900 going to sleep for 11 seconds 00000100:00100000:3.0:1782241283.144785:0:13782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1868815139993984:192.168.204.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782241283.151018:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241283.151321:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119986944 00000100:00100000:3.0:1782241283.151355:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119986944 00000100:00100000:3.0:1782241283.151458:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 78 00000100:00100000:3.0:1782241283.151471:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e48129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:11305:x1868815119986944:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782241283.151518:0:6510:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782241283.151685:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e48129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:11305:x1868815119986944:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 Request processed in 217us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241283.151694:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 78 00000100:00100000:2.0:1782241283.162575:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241283.163277:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119987072 00000100:00100000:3.0:1782241283.163293:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119987072 00000100:00100000:3.0:1782241283.163398:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 79 00000100:00100000:3.0:1782241283.163411:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4812aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:11305:x1868815119987072:12345-192.168.204.58@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1782241283.163651:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19c96 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.163675:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19c96 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.163690:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19c96 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.163955:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19c9d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.163990:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19c9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.164004:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19c9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.164041:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ca4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.164069:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.164076:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241283.164129:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1782241283.164134:0:10147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782241283.164149:0:10147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.164160:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19c96 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.164167:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19c96 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.164174:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19c96 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.164181:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241283.164185:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19c96 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.164192:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19c96 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.165113:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890e81fbc300) 00010000:00010000:3.0:1782241283.165118:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241283.165124:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19c96 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.165146:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19c96 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.165164:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19c9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.165169:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19c9d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.165176:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19c9d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.165181:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241283.165185:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19c9d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.165191:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19c9d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.165357:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff890e528b3d00) 00010000:00010000:3.0:1782241283.165361:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241283.165364:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19c9d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.165370:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19c9d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.165387:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.165392:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ca4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.165404:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.165409:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241283.165412:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.165418:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.165426:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:3.0:1782241283.165428:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241283.165430:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ca4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.165436:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ca4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241283.165534:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4812aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:11305:x1868815119987072:12345-192.168.204.58@tcp:34:lhsmtool_posix.0 Request processed in 2123us (2974us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241283.165544:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 79 00000100:00100000:1.0:1782241283.176682:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241283.176844:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119987328 00000100:00100000:0.0:1782241283.176857:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119987328 00000100:00100000:0.0:1782241283.176932:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 80 00000100:00100000:0.0:1782241283.176945:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:11305:x1868815119987328:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782241283.176985:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241283.177013:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19cab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335051c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.177196:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19cb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.177216:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.177231:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241283.177248:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1782241283.177369:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.177378:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19cb2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.177403:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.177410:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241283.177416:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.177424:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19cb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.177571:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241283.177576:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782241283.177583:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19cb2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.177591:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19cb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.177655:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19cab lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051c7 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.177668:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890e81fbc300) 00010000:00010000:0.0:1782241283.177671:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782241283.177675:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19cab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051c7 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.177686:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1800, rc 0) 00000100:00100000:0.0:1782241283.177798:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:11305:x1868815119987328:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 856us (1136us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1782241283.177816:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 80 00000100:00100000:2.0:1782241283.186882:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241283.186990:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119987456 00000100:00100000:0.0:1782241283.187010:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119987456 00000100:00100000:0.0:1782241283.187103:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 81 00000100:00100000:0.0:1782241283.187116:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:11305:x1868815119987456:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782241283.187171:0:6511:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782241283.187369:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:11305:x1868815119987456:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 Request processed in 254us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241283.187379:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 81 00000100:00100000:1.0:1782241283.199124:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241283.199280:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119987712 00000100:00100000:3.0:1782241283.199294:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119987712 00000100:00100000:3.0:1782241283.199376:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 82 00000100:00100000:3.0:1782241283.199389:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:11305:x1868815119987712:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782241283.199422:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241283.199426:0:10147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782241283.199465:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19c6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051b9 expref: 60 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.199515:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:3.0:1782241283.199523:0:10147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782241283.199545:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19cc0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335051ce expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782241283.200600:0:10147:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1782241283.200842:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19cc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.200861:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.202006:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.202217:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19cc0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ce expref: 62 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.202245:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ce expref: 61 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.202255:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890e528b3d00) 00010000:00010000:3.0:1782241283.202259:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782241283.202264:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c800, rc 0) 00000100:00100000:3.0:1782241283.203336:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+61:11305:x1868815119987712:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 3935us (4465us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1782241283.203351:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 82 00000100:00100000:2.0:1782241283.207056:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241283.207545:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119987968 00000100:00100000:3.0:1782241283.207558:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119987968 00000100:00100000:3.0:1782241283.207725:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 83 00000100:00100000:3.0:1782241283.207737:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+61:11305:x1868815119987968:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782241283.207861:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241283.207910:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19cc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ce expref: 61 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.207947:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890e528b3d00) 00010000:00010000:3.0:1782241283.207963:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782241283.208002:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19cd5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208019:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208030:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208195:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e19cdc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x918c34c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208221:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e19cdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x918c34c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208234:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e19cdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x918c34c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208289:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19cd5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208314:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19cd5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208322:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19cd5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208328:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241283.208333:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19cd5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208342:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19cd5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208357:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:3.0:1782241283.208361:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241283.208366:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19cd5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208373:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19cd5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208391:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e19cdc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x918c34c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208398:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e19cdc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x918c34c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208405:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e19cdc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x918c34c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208411:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164ce00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241283.208421:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e19cdc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x918c34c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208429:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e19cdc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x918c34c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208439:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x918c34c6 (ffff890e528b3e00) 00010000:00010000:3.0:1782241283.208443:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241283.208446:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e19cdc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x918c34c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.208452:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e19cdc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x918c34c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241283.208587:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:11305:x1868815119987968:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 847us (1541us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782241283.208600:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 83 00000100:00100000:2.0:1782241283.213335:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241283.214124:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119988096 00000100:00100000:1.0:1782241283.214157:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119988096 00000100:00100000:1.0:1782241283.214291:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 84 00000100:00100000:1.0:1782241283.214304:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:11305:x1868815119988096:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782241283.214328:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241283.214354:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19ce3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335051d5 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.214395:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19cea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.214409:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19cea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.214420:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19cea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.214559:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e19ce3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051d5 expref: 62 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.214582:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19cea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051d5 expref: 61 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.214591:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890e81fbc000) 00010000:00010000:1.0:1782241283.214595:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782241283.214599:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea200, rc 0) 00000100:00100000:1.0:1782241283.214691:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+61:11305:x1868815119988096:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 389us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241283.214699:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 84 00000100:00100000:1.0:1782241283.229580:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241283.231295:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119988352 00000100:00100000:0.0:1782241283.231318:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119988352 00000100:00100000:2.0:1782241283.231466:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 85 00000100:00100000:2.0:1782241283.231491:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+61:11305:x1868815119988352:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782241283.231586:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19cf1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.231607:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.231621:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782241283.231870:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1782241283.231881:0:6511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346490123913ns, next at 347490121483ns, rc = 0 00000004:00010000:2.0:1782241283.231953:0:6511:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006fce0b3e reply state 0000000056c852c6 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.231978:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19cf1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.231987:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890e81fbc000) 00010000:00010000:2.0:1782241283.231990:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1782241283.231993:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782241283.232115:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:11305:x1868815119988352:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 634us (2545us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1782241283.232124:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 85 00000100:00100000:3.0:1782241283.234568:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241283.234679:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119988480 00000100:00100000:0.0:1782241283.234692:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119988480 00000100:00100000:0.0:1782241283.234815:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 86 00000100:00100000:0.0:1782241283.234828:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:11305:x1868815119988480:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782241283.234864:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241283.234890:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19cf8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335051dc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.234988:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051dc expref: 64 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.235006:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051dc expref: 64 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.235031:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890e81fbc000) 00010000:00010000:0.0:1782241283.235051:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782241283.235134:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1800, rc 0) 00000100:00100000:0.0:1782241283.235223:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+64:11305:x1868815119988480:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 397us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241283.235231:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 86 00000100:00100000:3.0:1782241283.239284:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241283.239371:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119988608 00000100:00100000:0.0:1782241283.239384:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119988608 00000100:00100000:0.0:1782241283.239436:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 32 00000100:00100000:0.0:1782241283.239444:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1868815119988608:12345-192.168.204.58@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1782241283.239477:0:8425:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp t0 exp 0000000000000000 cur 346 last 0 00000020:00000080:0.0:1782241283.239523:0:8425:0:(genops.c:1406:class_connect()) connect: client 8052d7b9-50cc-405f-b8e0-5c9d863c1c52, cookie 0xc9959f2fb1e19cff 00002000:00100000:0.0:1782241283.239537:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8052d7b9-50cc-405f-b8e0-5c9d863c1c52/ffff890e53bee000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782241283.239557:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782241283.239635:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782241283.239671:0:8425:0:(import.c:65:import_set_state_nolock()) ffff890e521be000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782241283.239862:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2395:x1868815119988608:12345-192.168.204.58@tcp:8:lhsmtool_posix.0 Request processed in 416us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241283.239871:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 32 00000100:00100000:3.0:1782241283.242318:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241283.242372:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119988736 00000100:00100000:3.0:1782241283.242383:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119988736 00000100:00100000:3.0:1782241283.242473:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 33 00000100:00100000:3.0:1782241283.242485:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:0:x1868815119988736:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1782241283.242714:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1782241283.247134:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:3.0:1782241283.247167:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000100:00100000:0.0:1782241283.247426:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:0:x1868815119988736:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 Request processed in 4932us (5111us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1782241283.247442:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 33 00000100:00100000:0.0:1782241283.254186:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241283.254324:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119988992 00000100:00100000:1.0:1782241283.254338:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119988992 00000100:00100000:1.0:1782241283.254496:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:1.0:1782241283.254508:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+64:11305:x1868815119988992:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782241283.254731:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+65:11305:x1868815119988992:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 225us (561us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1782241283.254739:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:3.0:1782241283.258875:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241283.258997:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119989248 00000100:00100000:1.0:1782241283.259012:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119989248 00000100:00100000:1.0:1782241283.259085:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 87 00000100:00100000:1.0:1782241283.259095:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+65:11305:x1868815119989248:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782241283.259888:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+65:11305:x1868815119989248:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 790us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241283.259898:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 87 00000100:00100000:3.0:1782241283.276157:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241283.276283:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119989376 00000100:00100000:0.0:1782241283.276298:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119989376 00000100:00100000:0.0:1782241283.276372:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 88 00000100:00100000:0.0:1782241283.276395:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+65:11305:x1868815119989376:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782241283.276434:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241283.276463:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19d06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335051e3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.276556:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e19d0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.276574:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e19d0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.276588:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e19d0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241283.276648:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241283.276673:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e19d0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.276705:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e19d06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051e3 expref: 67 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.276726:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e19d0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051e3 expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.276736:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890e81fbc000) 00010000:00010000:0.0:1782241283.276739:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782241283.276744:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0600, rc 0) 00000100:00100000:0.0:1782241283.276867:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:11305:x1868815119989376:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 484us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241283.276876:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 88 00000100:00100000:2.0:1782241283.287937:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241283.288101:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119989504 00000100:00100000:3.0:1782241283.288119:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119989504 00000100:00100000:3.0:1782241283.288202:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 34 00000100:00100000:3.0:1782241283.288214:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815119989504:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782241283.288240:0:8746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241283.288272:0:8746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e19d14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335051ea expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782241283.288304:0:8746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3ad803, blocks: 0x0 00010000:00010000:3.0:1782241283.288329:0:8746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1782241283.288334:0:8746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241283.288346:0:8746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e19d14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ea expref: 6 pid: 8746 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.288369:0:8746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e19d14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ea expref: 6 pid: 8746 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.288386:0:8746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d000, rc 0) 00000100:00100000:3.0:1782241283.288481:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119989504:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 269us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241283.288491:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 34 00000100:00100000:3.0:1782241283.290959:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241283.291062:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119989760 00000100:00100000:2.0:1782241283.291079:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119989760 00000100:00100000:2.0:1782241283.291162:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 89 00000100:00100000:2.0:1782241283.291173:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:11305:x1868815119989760:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782241283.291379:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:11305:x1868815119989760:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 205us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241283.291456:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 89 00000100:00100000:2.0:1782241283.301810:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241283.302278:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119989888 00000100:00100000:0.0:1782241283.302296:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119989888 00000100:00100000:0.0:1782241283.302379:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 35 00000100:00100000:0.0:1782241283.302392:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:11305:x1868815119989888:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782241283.302419:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241283.302445:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5c8a270/0xc9959f2fb1e19d1b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335051f1 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.302496:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e19d14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ea expref: 7 pid: 8746 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.302508:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241283.302514:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241283.302520:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5c8a270/0xc9959f2fb1e19d1b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051f1 expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.302567:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e19d14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ea expref: 7 pid: 8746 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.302584:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e19d14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ea expref: 7 pid: 8746 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241283.302601:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8425:1868815139994112:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241283.302730:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e779636c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241283.309575:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8425:1868815139994112:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241283.309632:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b5c8a270/0xc9959f2fb1e19d1b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051f1 expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.309662:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0800, rc 0) 00000100:00100000:1.0:1782241283.309747:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:11305:x1868815119989888:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 7357us (7949us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241283.309803:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 35 00000100:00100000:2.0:1782241283.312243:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241283.313703:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119990016 00000100:00100000:0.0:1782241283.313718:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119990016 00010000:00010000:0.0:1782241283.313795:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e19d14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ea expref: 7 pid: 8746 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241283.313863:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 59 00000100:00100000:0.0:1782241283.313872:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2399:x1868815119990016:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241283.313901:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241283.313926:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e19d14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ea expref: 7 pid: 8746 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.313939:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e19d14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ea expref: 7 pid: 8746 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.313973:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e19d14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ea expref: 7 pid: 8746 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.313991:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241283.313995:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241283.314004:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5c8a270/0xc9959f2fb1e19d1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051f1 expref: 6 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.314014:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5c8a270/0xc9959f2fb1e19d1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051f1 expref: 6 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.314054:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b5c8a270/0xc9959f2fb1e19d1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051f1 expref: 6 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241283.314068:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6496:1868815139994240:192.168.204.58@tcp:105: 00000100:00100000:0.0:1782241283.314941:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e779636c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241283.323252:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6496:1868815139994240:192.168.204.58@tcp:105: 00010000:00010000:0.0:1782241283.323282:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241283.323343:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119990016:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 9470us (11108us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241283.323355:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 59 00000100:00100000:3.0:1782241283.324050:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241283.324176:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119990144 00000100:00100000:1.0:1782241283.324187:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119990144 00002000:00100000:1.0:1782241283.324254:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff890e7f685880 x1868815119990144/t0(0) o4->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:374/0 lens 504/0 e 0 to 0 dl 1782241294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782241283.324292:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890e7f685880 with x1868815119990144 ext(0->8) 00002000:00010000:1.0:1782241283.324301:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff890e7f685880 00000100:00100000:1.0:1782241283.324340:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:1.0:1782241283.324350:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119990144:12345-192.168.204.58@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1782241283.327464:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2399:x1868815119990144:12345-192.168.204.58@tcp:4:lhsmtool_posix.0 Request processed in 3103us (3412us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1782241283.327480:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 0 00002000:00100000:1.0:1782241283.327494:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff890e7f685880 x1868815119990144/t4294967303(0) o4->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:374/0 lens 504/448 e 0 to 0 dl 1782241294 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782241283.327504:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890e7f685880 with x1868815119990144 ext(0->8) 00002000:00010000:1.0:1782241283.327510:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff890e7f685880 00000100:00100000:2.0:1782241283.330844:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241283.331020:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119990272 00000100:00100000:1.0:1782241283.331030:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119990272 00000100:00100000:1.0:1782241283.331092:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 90 00000100:00100000:1.0:1782241283.331103:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:11305:x1868815119990272:12345-192.168.204.58@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1782241283.332974:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782241283.332995:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139994368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782241283.333170:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241283.333919:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139994368 00000100:00100000:0.0:1782241283.333929:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139994368 00000100:00100000:0.0:1782241283.334009:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782241283.334021:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139994368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782241283.334050:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782241283.334130:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139994368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241283.334137:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782241283.334202:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139994368:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1782241283.334274:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1782241283.334621:0:8745:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 346592862522ns, next at 347592859843ns, rc = 0 00000100:00100000:2.0:1782241283.335023:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241283.335050:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139994496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782241283.335099:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241283.335239:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139994496 00000100:00100000:0.0:1782241283.335246:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139994496 00000100:00080000:2.0:1782241283.335361:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241283.335612:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1782241283.335623:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815139994496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782241283.335642:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782241283.335717:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815139994496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241283.335724:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1782241283.335810:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139994496:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1782241283.341880:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1782241283.341902:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:1.0:1782241283.341972:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1782241283.341997:0:6489:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff890e77963240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1782241283.342002:0:6489:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e7788c600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff890e77963300 00000020:00080000:1.0:1782241283.342005:0:6489:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e7788ce00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff890e8149dc00 00000100:00100000:1.0:1782241283.342192:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:11305:x1868815119990272:12345-192.168.204.58@tcp:44:lhsmtool_posix.0 Request processed in 11086us (11355us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241283.342219:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 90 00000100:00100000:2.0:1782241283.342484:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241283.342500:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139994624:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1782241283.342559:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782241283.342698:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181200/0xc9959f2fb1e19a35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342730:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181200/0xc9959f2fb1e19a35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342737:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181200/0xc9959f2fb1e19a35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342743:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e47181200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241283.342747:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181200/0xc9959f2fb1e19a35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342782:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181200/0xc9959f2fb1e19a35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342801:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff890e528b3c00) 00010000:00010000:0.0:1782241283.342804:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241283.342810:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181200/0xc9959f2fb1e19a35 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342816:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181200/0xc9959f2fb1e19a35 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342837:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181a00/0xc9959f2fb1e19a3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342843:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181a00/0xc9959f2fb1e19a3c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342848:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181a00/0xc9959f2fb1e19a3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342852:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e47181a00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241283.342862:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181a00/0xc9959f2fb1e19a3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342868:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181a00/0xc9959f2fb1e19a3c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342876:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:0.0:1782241283.342879:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241283.342882:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181a00/0xc9959f2fb1e19a3c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342888:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e47181a00/0xc9959f2fb1e19a3c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342900:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19a7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342905:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19a7b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342910:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19a7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342915:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164dc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241283.342918:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19a7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342923:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19a7b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342930:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890e528b3300) 00010000:00010000:0.0:1782241283.342932:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241283.342941:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19a7b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342947:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19a7b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342975:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19b85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342982:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19b85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342988:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19b85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.342994:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241283.342997:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19b85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343002:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19b85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343011:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241283.343013:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241283.343016:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19b85 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343020:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19b85 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343030:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19ba8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343035:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19ba8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343046:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19ba8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343051:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43face00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241283.343054:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19ba8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343061:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19ba8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343068:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241283.343070:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241283.343072:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19ba8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343077:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19ba8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343086:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19bee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343091:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19bee lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343096:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19bee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343101:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241283.343103:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19bee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343117:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19bee lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343124:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241283.343127:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241283.343129:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19bee lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343147:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19bee lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343161:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19cf1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343166:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19cf1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343172:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19cf1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343177:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241283.343179:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19cf1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343184:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19cf1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343192:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890e81fbc000) 00010000:00010000:0.0:1782241283.343194:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782241283.343196:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19cf1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.343212:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19cf1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782241283.343229:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1782241283.343386:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1782241283.343405:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139994624 00000100:00100000:0.0:1782241283.343413:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139994624 00000100:00100000:0.0:1782241283.343467:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782241283.343476:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815139994624:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1782241283.343575:0:8423:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1782241283.343579:0:8423:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1782241283 00002000:00010000:0.0:1782241283.343581:0:8423:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782241283.343583:0:8423:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1782241283 -> 1782241283 00002000:00010000:0.0:1782241283.343585:0:8423:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1782241283.343654:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815139994624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (1094us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1782241283.343660:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00080000:0.0:1782241283.343703:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890e47ae9f80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1782241283.343709:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139994624:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1782241283.343923:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782241283.346309:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139994752:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782241283.346373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241283.347021:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139994752 00000100:00100000:3.0:1782241283.347031:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139994752 00000100:00100000:3.0:1782241283.347181:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782241283.347192:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815139994752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782241283.347223:0:8746:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1782241283.347265:0:8746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a3ad801, atime: 0x6a3ad801, ctime: 0x6a3ad801, blocks: 0x8 00010000:00010000:3.0:1782241283.347275:0:8746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19d22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.347291:0:8746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1782241283.347296:0:8746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241283.347302:0:8746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19d22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.347321:0:8746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19d22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.347331:0:8746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19d22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.347339:0:8746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19d22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.347366:0:8746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782241283.347544:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3639:x1868815139994752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 354us (1170us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1782241283.347552:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1782241283.347783:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890e7f684e00/2, rc 0, transno 4294967302 00000100:00100000:3.0:1782241283.347790:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815139994752:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782241283.347880:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241283.347888:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19d22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.347898:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164ce00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241283.347903:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19d22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.347913:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19d22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.347931:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19d22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.347938:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19d22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.347957:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241283.347959:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241283.347961:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241283.355428:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241283.355719:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119990400 00000100:00100000:1.0:1782241283.355729:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119990400 00000100:00100000:1.0:1782241283.355826:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 38 00000100:00100000:1.0:1782241283.355838:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2398:x1868815119990400:12345-192.168.204.58@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1782241283.363022:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1782241283.363046:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1782241283.371629:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2398:x1868815119990400:12345-192.168.204.58@tcp:16:lhsmtool_posix.0 Request processed in 15783us (16200us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241283.371643:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 38 00000100:00100000:1.0:1782241283.378384:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241283.378477:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119990656 00000100:00100000:3.0:1782241283.378487:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119990656 00000100:00100000:3.0:1782241283.378555:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 91 00000100:00100000:3.0:1782241283.378565:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:11305:x1868815119990656:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782241283.378638:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241283.378666:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e19d0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051e3 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.378681:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890e81fbc000) 00010000:00010000:3.0:1782241283.378687:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782241283.378718:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19d29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.378732:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19d29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.378742:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19d29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782241283.378913:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2c07af7 reply state 0000000001f07e9a transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19d29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.378926:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19d29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.378932:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890e81fbc000) 00010000:00010000:3.0:1782241283.378934:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782241283.378937:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782241283.379059:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+15:11305:x1868815119990656:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 494us (680us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1782241283.379077:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 91 00000100:00100000:1.0:1782241283.382062:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241283.382155:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119990784 00000100:00100000:0.0:1782241283.382165:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119990784 00000100:00100000:0.0:1782241283.382222:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 39 00000100:00100000:0.0:1782241283.382233:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119990784:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782241283.382395:0:8747:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1782241283.382398:0:8747:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1782241283 -> 1782241282 00002000:00010000:0.0:1782241283.382410:0:8747:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1782241281 00002000:00010000:0.0:1782241283.382412:0:8747:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1782241283 -> 1782241282 00002000:00010000:0.0:1782241283.382414:0:8747:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1782241283.382479:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2399:x1868815119990784:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 Request processed in 247us (425us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1782241283.382486:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 39 00000100:00100000:1.0:1782241283.385603:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241283.385685:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119991040 00000100:00100000:0.0:1782241283.385693:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119991040 00000100:00100000:0.0:1782241283.385750:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 92 00000100:00100000:0.0:1782241283.385786:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+15:11305:x1868815119991040:12345-192.168.204.58@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1782241283.385858:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.385876:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19cea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051d5 expref: 15 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.385886:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d30 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.385922:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19cea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051d5 expref: 15 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.385936:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19cea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051d5 expref: 15 pid: 11191 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241283.385950:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48098000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1868815139994880:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241283.386048:0:6510:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e779636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241283.390125:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241283.394122:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119991168 00000100:00100000:0.0:1782241283.394152:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119991168 00010000:00010000:0.0:1782241283.394200:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19cea lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051d5 expref: 16 pid: 11191 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241283.394245:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 60 00000100:00100000:0.0:1782241283.394257:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+16:2398:x1868815119991168:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241283.394274:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241283.394281:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19cea lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051d5 expref: 16 pid: 11191 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.394295:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19cea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051d5 expref: 16 pid: 11191 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.394319:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890e81fbc000) 00010000:00010000:0.0:1782241283.394324:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.394334:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.394342:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d30 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.394362:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241283.394422:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+16:2398:x1868815119991168:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 167us (4310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241283.394431:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 60 00010000:00010000:0.0:1782241283.394505:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19cea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051d5 expref: 15 pid: 11191 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241283.394533:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48098000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1868815139994880:192.168.204.58@tcp:104: 00010000:00010000:0.0:1782241283.394555:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.394565:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.394571:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.394616:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.394623:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d30 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.394630:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d30 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.394636:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1a00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241283.394640:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d30 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.394647:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d30 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.394656:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890e81fbc000) 00010000:00010000:0.0:1782241283.394659:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782241283.394664:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d30 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.394676:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d30 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241283.394734:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:11305:x1868815119991040:12345-192.168.204.58@tcp:55:lhsmtool_posix.0 Request processed in 8949us (9138us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782241283.394742:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 92 00000100:00100000:3.0:1782241283.403378:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241283.408774:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119991296 00000100:00100000:1.0:1782241283.408798:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119991296 00000100:00100000:1.0:1782241283.408900:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 40 00000100:00100000:1.0:1782241283.408913:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2399:x1868815119991296:12345-192.168.204.58@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782241283.409005:0:8746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a2380bd3/0xc9959f2fb1e19d37 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.409034:0:8746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5c8a270/0xc9959f2fb1e19d1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051f1 expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.409045:0:8746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241283.409050:0:8746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782241283.409055:0:8746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2380bd3/0xc9959f2fb1e19d37 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.409105:0:8746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b5c8a270/0xc9959f2fb1e19d1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051f1 expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.409124:0:8746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b5c8a270/0xc9959f2fb1e19d1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051f1 expref: 7 pid: 8425 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241283.409143:0:8746:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47875880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8746:1868815139995008:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241283.409270:0:8746:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748480 going to sleep for 11 seconds 00000100:00100000:1.0:1782241283.416523:0:8746:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47875880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8746:1868815139995008:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241283.416576:0:8746:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a2380bd3/0xc9959f2fb1e19d37 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241283.416578:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241283.417123:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119991424 00000100:00100000:3.0:1782241283.417134:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119991424 00010000:00010000:3.0:1782241283.417188:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b5c8a270/0xc9959f2fb1e19d1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051f1 expref: 8 pid: 8425 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241283.417300:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 61 00000100:00100000:3.0:1782241283.417315:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2397:x1868815119991424:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241283.417338:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241283.417369:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b5c8a270/0xc9959f2fb1e19d1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051f1 expref: 8 pid: 8425 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.417393:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b5c8a270/0xc9959f2fb1e19d1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051f1 expref: 8 pid: 8425 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.417432:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5c8a270/0xc9959f2fb1e19d1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051f1 expref: 8 pid: 8425 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.417451:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782241283.417457:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782241283.417465:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2380bd3/0xc9959f2fb1e19d37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.417477:0:10331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2380bd3/0xc9959f2fb1e19d37 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.417544:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241283.417645:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2397:x1868815119991424:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 333us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241283.417660:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 61 00010000:00010000:1.0:1782241283.417981:0:8746:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a2380bd3/0xc9959f2fb1e19d37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.417993:0:8746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2380bd3/0xc9959f2fb1e19d37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.418020:0:8746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a2380bd3/0xc9959f2fb1e19d37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.418031:0:8746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2380bd3/0xc9959f2fb1e19d37 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.418041:0:8746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2380bd3/0xc9959f2fb1e19d37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.418049:0:8746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ebc00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241283.418054:0:8746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2380bd3/0xc9959f2fb1e19d37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.418064:0:8746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2380bd3/0xc9959f2fb1e19d37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.418097:0:8746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2380bd3/0xc9959f2fb1e19d37 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.418105:0:8746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2380bd3/0xc9959f2fb1e19d37 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241283.418174:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815119991296:12345-192.168.204.58@tcp:1:lhsmtool_posix.0 Request processed in 9263us (14814us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241283.418186:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 40 00000100:00100000:3.0:1782241283.425612:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241283.426910:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119991680 00000100:00100000:0.0:1782241283.426925:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119991680 00000100:00100000:0.0:1782241283.427000:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 93 00000100:00100000:0.0:1782241283.427012:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:11305:x1868815119991680:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782241283.427103:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d3e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.427120:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19b7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350517a expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.427130:0:11191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d3e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.427167:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19b7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350517a expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.427182:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19b7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350517a expref: 14 pid: 6512 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241283.427197:0:11191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48098000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11191:1868815139995136:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241283.427291:0:11191:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77963d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241283.436289:0:11191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48098000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11191:1868815139995136:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241283.436319:0:11191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d3e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241283.439173:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241283.439253:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119991808 00000100:00100000:0.0:1782241283.439262:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119991808 00010000:00010000:0.0:1782241283.439300:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19b7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350517a expref: 15 pid: 6512 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241283.439359:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 62 00000100:00100000:0.0:1782241283.439369:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e477c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+15:2398:x1868815119991808:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241283.439384:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241283.439392:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19b7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350517a expref: 15 pid: 6512 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.439406:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19b7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350517a expref: 15 pid: 6512 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.439440:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19b7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350517a expref: 15 pid: 6512 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.439458:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241283.439463:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d3e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.439474:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.439482:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d3e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.439511:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241283.439563:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e477c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:2398:x1868815119991808:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 195us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241283.439589:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 62 00010000:00010000:0.0:1782241283.439734:0:11191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.439743:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.439954:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19d45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.439978:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19cf8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051dc expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.439986:0:11191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19d45 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.440022:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051dc expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.440035:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19cf8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051dc expref: 14 pid: 6510 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241283.440048:0:11191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48098000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11191:1868815139995264:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241283.440109:0:11191:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77963d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782241283.458327:0:11191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48098000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11191:1868815139995264:192.168.204.58@tcp:104: 00010000:00010000:0.0:1782241283.458371:0:11191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19d45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241283.458495:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241283.458525:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119991936 00000100:00100000:0.0:1782241283.458532:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119991936 00010000:00010000:0.0:1782241283.458568:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19cf8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051dc expref: 15 pid: 6510 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241283.458605:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 63 00000100:00100000:0.0:1782241283.458614:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+15:2399:x1868815119991936:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241283.458628:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241283.458635:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19cf8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051dc expref: 15 pid: 6510 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.458647:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051dc expref: 15 pid: 6510 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.458669:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e19cf8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051dc expref: 15 pid: 6510 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.458683:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890e81fbc000) 00010000:00010000:0.0:1782241283.458688:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19d45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.458697:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19d45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.458705:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19d45 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.458737:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241283.458805:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:2399:x1868815119991936:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 190us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241283.458813:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 63 00010000:00010000:0.0:1782241283.458916:0:11191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19d45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.458923:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19d45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782241283.459065:0:11191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1782241283.459182:0:11191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1782241283.459222:0:11191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1782241283.459297:0:11191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11191:1868815139995392:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1782241283.459342:0:11191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241283.459386:0:11191:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77963180 going to sleep for 11 seconds 00000100:00100000:3.0:1782241283.460365:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139995392 00000100:00100000:3.0:1782241283.460374:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139995392 00000100:00100000:3.0:1782241283.460808:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782241283.460821:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11191:x1868815139995392:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1782241283.460933:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11191:x1868815139995392:12345-0@lo:1000:mdt00_004.0 Request processed in 115us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241283.460940:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1782241283.461909:0:11191:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1782241283.461919:0:11191:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff890e47ae9f80, transno 4294967304 00000100:00100000:1.0:1782241283.461950:0:11191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11191:1868815139995392:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1782241283.463947:0:11191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1782241283.464079:0:11191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47875880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11191:1868815139995520:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782241283.464161:0:11191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241283.464205:0:11191:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47bfce40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241283.465020:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139995520 00000100:00100000:2.0:1782241283.465033:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139995520 00000100:00100000:2.0:1782241283.465107:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782241283.465118:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:11191:x1868815139995520:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1782241283.465337:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:11191:x1868815139995520:12345-0@lo:1000:mdt00_004.0 Request processed in 219us (1175us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782241283.465346:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782241283.465530:0:11191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47875880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11191:1868815139995520:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1782241283.465582:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19d45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465594:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19d45 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465620:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19d45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465626:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1c00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241283.465631:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19d45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465639:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19d45 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465655:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890e81fbc000) 00010000:00010000:1.0:1782241283.465658:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782241283.465662:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19d45 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465668:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e19d45 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465702:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19c73 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465709:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19c73 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465715:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19c73 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465721:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fadc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241283.465724:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19c73 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465740:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19c73 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465749:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241283.465751:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782241283.465779:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19c73 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465787:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19c73 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465813:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19d4c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465828:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19c8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051c0 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465836:0:11191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19d4c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465868:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19c8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051c0 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.465882:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19c8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051c0 expref: 17 pid: 6512 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241283.465896:0:11191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47877800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11191:1868815139995648:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241283.465982:0:11191:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47bfce40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241283.471798:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241283.471877:0:11191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47877800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11191:1868815139995648:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241283.471906:0:11191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19d4c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241283.472636:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119992064 00000100:00100000:3.0:1782241283.472645:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119992064 00010000:00010000:3.0:1782241283.472683:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19c8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051c0 expref: 18 pid: 6512 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241283.472726:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 64 00000100:00100000:3.0:1782241283.472734:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47876300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:2399:x1868815119992064:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241283.472748:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241283.472775:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19c8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051c0 expref: 18 pid: 6512 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.472789:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19c8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051c0 expref: 18 pid: 6512 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.472819:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19c8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051c0 expref: 18 pid: 6512 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.472832:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:3.0:1782241283.472837:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19d4c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.472846:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19d4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.472853:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19d4c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.472882:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241283.472940:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47876300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+17:2399:x1868815119992064:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 205us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241283.472948:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 64 00010000:00010000:2.0:1782241283.474665:0:11191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19d4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.474685:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19d4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.474700:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19d4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.474716:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19d4c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.474723:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19d4c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.474729:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ebc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241283.474734:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19d4c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.474741:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19d4c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.474783:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241283.474787:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241283.474792:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19d4c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.474798:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19d4c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.474811:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.474817:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d3e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.474823:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d3e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.474828:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1a00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241283.474837:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d3e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.474844:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d3e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.474853:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241283.474856:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782241283.474859:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d3e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.474864:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e19d3e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241283.475105:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+16:11305:x1868815119991680:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 48090us (49505us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1782241283.475117:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 93 00000020:00080000:2.0:1782241283.475123:0:11191:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782241283.478635:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782241283.478644:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782241283.478662:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782241283.478668:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782241283.488723:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241283.489126:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119992320 00000100:00100000:0.0:1782241283.489136:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119992320 00000100:00100000:0.0:1782241283.489201:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:0.0:1782241283.489213:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+16:11305:x1868815119992320:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1782241283.489677:0:6513:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1782241283.489714:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1782241283.489753:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19d53 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.489800:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19d53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.489812:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19d53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.489837:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19d53 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.489845:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19d53 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.489852:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19d53 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.489872:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782241283.489976:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:11305:x1868815119992320:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 763us (1260us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1782241283.489985:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 20 00000020:00080000:0.0:1782241283.489991:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782241283.490173:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241283.490180:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19d53 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.490189:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0e00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241283.490193:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19d53 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.490286:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19d53 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.490302:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890e81fbc000) 00010000:00010000:3.0:1782241283.490305:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782241283.490310:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19d53 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.490316:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e19d53 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241283.490328:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241283.490330:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241283.490332:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241283.724229:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782241283.774578:0:14215:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782241283.774589:0:14215:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782241283.774697:0:14215:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1782241283.774705:0:14215:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782241283.904670:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241283.904799:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119992576 00000100:00100000:1.0:1782241283.904811:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119992576 00000100:00100000:1.0:1782241283.904875:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 94 00000100:00100000:1.0:1782241283.904888:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:11315:x1868815119992576:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241283.904920:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241283.904942:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e19d5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335051f8 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.905072:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e19d61 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.905088:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e19d61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.905103:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e19d61 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241283.905114:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1782241283.905227:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e19d5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051f8 expref: 21 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.905246:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e19d61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051f8 expref: 20 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241283.905254:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:1.0:1782241283.905265:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782241283.905269:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eba00, rc 0) 00000100:00100000:1.0:1782241283.905332:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:11315:x1868815119992576:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 447us (672us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1782241283.905340:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 94 00000100:00100000:0.0:1782241283.909032:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241283.909126:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119992704 00000100:00100000:2.0:1782241283.909136:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119992704 00000100:00100000:2.0:1782241283.909204:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 95 00000100:00100000:2.0:1782241283.909215:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:11315:x1868815119992704:12345-192.168.204.58@tcp:34:lfs.0 00010000:00010000:2.0:1782241283.909305:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d6f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.909323:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d6f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.909336:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d6f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.909362:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.909369:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.909375:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.909537:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19d7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.909547:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19d7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.909554:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19d7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782241283.910050:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19d7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910068:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d6f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910075:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d6f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910082:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910089:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241283.910093:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910111:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d6f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910131:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:2.0:1782241283.910135:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241283.910140:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910146:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910161:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910168:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910174:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910180:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241283.910183:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910189:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910195:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890d4781b000) 00010000:00010000:2.0:1782241283.910198:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241283.910201:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d76 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910217:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910233:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19d7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910240:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19d7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910246:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19d7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910251:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241283.910254:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19d7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910260:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19d7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910267:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b100) 00010000:00010000:2.0:1782241283.910270:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241283.910272:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19d7d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.910278:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19d7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241283.910374:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:11315:x1868815119992704:12345-192.168.204.58@tcp:34:lfs.0 Request processed in 1159us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241283.910385:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 95 00000100:00100000:1.0:1782241283.958159:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241283.958235:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119992960 00000100:00100000:2.0:1782241283.958247:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119992960 00000100:00100000:2.0:1782241283.958315:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 96 00000100:00100000:2.0:1782241283.958327:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:11318:x1868815119992960:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241283.958357:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241283.958390:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19d84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335051ff expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958482:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d8b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958507:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958520:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958535:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958543:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958549:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958678:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19d99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958686:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958706:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241283.958718:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1782241283.958834:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958842:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d8b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958849:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958855:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241283.958859:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958866:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d8b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958878:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:2.0:1782241283.958881:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241283.958886:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958892:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19d8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958904:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958910:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958923:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958928:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241283.958930:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958936:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958944:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890d4781b100) 00010000:00010000:2.0:1782241283.958947:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241283.958949:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.958965:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19d92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.959006:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19d84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ff expref: 23 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.959018:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19d99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ff expref: 22 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241283.959024:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b000) 00010000:00010000:2.0:1782241283.959027:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241283.959028:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fac600, rc 0) 00000100:00100000:2.0:1782241283.959084:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:11318:x1868815119992960:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 759us (935us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1782241283.959101:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 96 00000100:00100000:1.0:1782241283.970193:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241283.971052:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119993088 00000100:00100000:0.0:1782241283.971062:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119993088 00000100:00100000:0.0:1782241283.971114:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 97 00000100:00100000:0.0:1782241283.971124:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:11318:x1868815119993088:12345-192.168.204.58@tcp:54:lfs.0 00010000:00010000:0.0:1782241283.971195:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19da7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.971213:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19da7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.971233:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19da7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.971271:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19da7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.971278:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19da7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.971285:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19da7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.971290:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241283.971294:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19da7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.971300:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19da7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.971312:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b000) 00010000:00010000:0.0:1782241283.971315:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782241283.971321:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19da7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241283.971327:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19da7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241283.971412:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:11318:x1868815119993088:12345-192.168.204.58@tcp:54:lfs.0 Request processed in 289us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241283.971420:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 97 00000100:00100000:3.0:1782241283.978388:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241283.978427:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119993344 00000100:00100000:3.0:1782241283.978438:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119993344 00000100:00100000:3.0:1782241283.978489:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:3.0:1782241283.978499:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47a49450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:11318:x1868815119993344:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:3.0:1782241283.978716:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47a49450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+23:11318:x1868815119993344:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 217us (337us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1782241283.978725:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:1.0:1782241284.041337:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241284.041431:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119993600 00000100:00100000:2.0:1782241284.041447:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119993600 00000100:00080000:3.0:1782241284.041549:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241284.041559:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 98 00000100:00100000:2.0:1782241284.041575:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+23:10845:x1868815119993600:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:2.0:1782241284.041613:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241284.041635:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19dae lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505206 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.041795:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19db5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.041810:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19d99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ff expref: 24 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.041820:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19db5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.041854:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19d99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ff expref: 24 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.041867:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19d99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ff expref: 24 pid: 11191 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241284.041881:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a98700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1868815139995776:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241284.041995:0:6510:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47ac1480 going to sleep for 11 seconds 00000100:00100000:3.0:1782241284.045526:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241284.045696:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a98700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1868815139995776:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241284.045752:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19db5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241284.046118:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119993728 00000100:00100000:0.0:1782241284.046199:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119993728 00010000:00010000:1.0:1782241284.046661:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19d99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ff expref: 25 pid: 11191 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241284.046800:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 65 00000100:00100000:1.0:1782241284.046813:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+25:2398:x1868815119993728:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241284.046833:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241284.046842:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19d99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ff expref: 25 pid: 11191 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.046856:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19d99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ff expref: 25 pid: 11191 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.046886:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19d99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051ff expref: 25 pid: 11191 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.046909:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b000) 00010000:00010000:1.0:1782241284.046915:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19db5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.046927:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19db5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.046947:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19db5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.046984:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241284.047255:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+24:2398:x1868815119993728:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 443us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241284.047265:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 65 00010000:00010000:2.0:1782241284.047343:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19db5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.047352:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19db5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241284.047390:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1782241284.047586:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19dae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505206 expref: 25 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.047606:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19db5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505206 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.047615:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b000) 00010000:00010000:2.0:1782241284.047618:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782241284.047621:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad200, rc 0) 00000100:00100000:2.0:1782241284.047653:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+24:10845:x1868815119993600:12345-192.168.204.58@tcp:101:bash.0 Request processed in 6083us (6333us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1782241284.047662:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 98 00000100:00100000:3.0:1782241284.052403:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241284.052978:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119993856 00000100:00100000:1.0:1782241284.052991:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119993856 00000100:00100000:1.0:1782241284.053182:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 99 00000100:00100000:1.0:1782241284.053195:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+24:10845:x1868815119993856:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:1.0:1782241284.053230:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241284.053256:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19dc3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350520d expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.053297:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e19dca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.053313:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e19dca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.053325:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e19dca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.053485:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e19dc3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350520d expref: 26 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.053507:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e19dca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350520d expref: 25 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.053525:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b000) 00010000:00010000:1.0:1782241284.053528:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782241284.053533:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea600, rc 0) 00000100:00100000:1.0:1782241284.053615:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+25:10845:x1868815119993856:12345-192.168.204.58@tcp:101:bash.0 Request processed in 421us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241284.053623:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 99 00000100:00100000:3.0:1782241284.059632:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241284.059822:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119994112 00000100:00100000:0.0:1782241284.059836:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119994112 00000100:00100000:0.0:1782241284.059915:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 100 00000100:00100000:0.0:1782241284.059927:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+25:10845:x1868815119994112:12345-192.168.204.58@tcp:36:bash.0 00010000:00010000:0.0:1782241284.060282:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19dd1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.060306:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.060320:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782241284.060377:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1782241284.060403:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000073acedf3 reply state 00000000524db7c3 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.060419:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19dd1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.060428:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b000) 00010000:00010000:0.0:1782241284.060431:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782241284.060436:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1782241284.060480:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1782241284.060625:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+29:10845:x1868815119994112:12345-192.168.204.58@tcp:36:bash.0 Request processed in 699us (1007us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1782241284.060635:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 100 00000020:00080000:0.0:1782241284.060641:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1782241284.070203:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241284.073062:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119994240 00000100:00100000:2.0:1782241284.073084:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119994240 00000100:00100000:2.0:1782241284.073241:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 101 00000100:00100000:2.0:1782241284.073253:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+29:10845:x1868815119994240:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:2.0:1782241284.073287:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241284.073315:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19dd8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505214 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.073415:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505214 expref: 30 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.073434:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505214 expref: 30 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.073456:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b000) 00010000:00010000:2.0:1782241284.073460:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782241284.073464:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fac000, rc 0) 00000100:00100000:2.0:1782241284.073559:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+30:10845:x1868815119994240:12345-192.168.204.58@tcp:101:bash.0 Request processed in 308us (3374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241284.073568:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 101 00000100:00100000:3.0:1782241284.077714:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241284.077916:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119994368 00000100:00100000:2.0:1782241284.077930:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119994368 00000100:00100000:2.0:1782241284.078002:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 41 00000100:00100000:2.0:1782241284.078013:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:10845:x1868815119994368:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:2.0:1782241284.078037:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241284.078067:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e19ddf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350521b expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782241284.078101:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a3ad802, atime: 0x6a3ad801, ctime: 0x6a3ad802, blocks: 0x8 00010000:00010000:2.0:1782241284.078131:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1782241284.078139:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241284.078148:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e19ddf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350521b expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.078185:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e19ddf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350521b expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.078202:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43faca00, rc 0) 00000100:00100000:2.0:1782241284.078284:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:10845:x1868815119994368:12345-192.168.204.58@tcp:101:bash.0 Request processed in 272us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241284.078292:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 41 00000100:00100000:3.0:1782241284.080981:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241284.081102:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119994496 00000100:00100000:2.0:1782241284.081115:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119994496 00002000:00010000:2.0:1782241284.081167:0:8429:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1782241284.081173:0:8429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d4809aa00 with x1868815119994496 ext(0->18446744073709551615) 00002000:00010000:2.0:1782241284.081188:0:8429:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff890d4809aa00. 00000100:00100000:2.0:1782241284.081225:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 1 00000100:00100000:2.0:1782241284.081235:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2398:x1868815119994496:12345-192.168.204.58@tcp:10:bash.0 00002000:00010000:2.0:1782241284.081592:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1782241284.081597:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1782241282 -> 1782241284 00002000:00010000:2.0:1782241284.081600:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1782241281 -> 1782241281 00002000:00010000:2.0:1782241284.081603:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1782241282 -> 1782241284 00002000:00010000:2.0:1782241284.081605:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1782241284.081680:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2398:x1868815119994496:12345-192.168.204.58@tcp:10:bash.0 Request processed in 444us (712us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1782241284.081688:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 1 00002000:00010000:2.0:1782241284.081692:0:8429:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1782241284.081695:0:8429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d4809aa00 with x1868815119994496 ext(0->18446744073709551615) 00002000:00010000:2.0:1782241284.081712:0:8429:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff890d4809aa00. 00000100:00100000:3.0:1782241284.168643:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241284.171927:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119994624 00000100:00100000:1.0:1782241284.171963:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119994624 00000100:00100000:2.0:1782241284.172203:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 102 00000100:00100000:2.0:1782241284.172216:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+30:11332:x1868815119994624:12345-192.168.204.58@tcp:34:lfs.0 00010000:00010000:2.0:1782241284.172324:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19de6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172348:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19de6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172362:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19de6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172382:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19ded lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172390:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19ded lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172397:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19ded lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172498:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19df4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172508:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19df4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172515:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19df4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782241284.172577:0:10147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19df4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172612:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19de6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172618:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19de6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172625:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19de6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172632:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241284.172636:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19de6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172644:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19de6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172659:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:2.0:1782241284.172662:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241284.172667:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19de6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172674:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19de6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172690:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19ded lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172697:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19ded lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172702:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19ded lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172716:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241284.172719:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19ded lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172726:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19ded lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172735:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890d4781b200) 00010000:00010000:2.0:1782241284.172737:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241284.172741:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19ded lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.172748:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19ded lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.176098:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19df4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.176120:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19df4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.176129:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19df4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.176135:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241284.176140:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19df4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.176148:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19df4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.176199:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b000) 00010000:00010000:2.0:1782241284.176202:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241284.176208:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19df4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.176214:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19df4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241284.176377:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+30:11332:x1868815119994624:12345-192.168.204.58@tcp:34:lfs.0 Request processed in 4157us (7744us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241284.176390:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 102 00000100:00100000:1.0:1782241284.257358:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241284.257507:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119994880 00000100:00100000:2.0:1782241284.257520:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119994880 00000100:00100000:2.0:1782241284.257615:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 103 00000100:00100000:2.0:1782241284.257628:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+30:11335:x1868815119994880:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241284.257657:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241284.257685:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19dfb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505222 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.257846:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e02 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.257864:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.257878:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.257894:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.257920:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.257927:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258080:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258091:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258098:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241284.258111:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1782241284.258217:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258225:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e02 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258233:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258240:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241284.258245:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258254:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e02 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258282:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:2.0:1782241284.258286:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241284.258292:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258299:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258317:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258324:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258330:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258336:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241284.258339:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258345:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258352:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890d4781b200) 00010000:00010000:2.0:1782241284.258355:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241284.258357:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e09 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258364:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258423:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19dfb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505222 expref: 33 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258438:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505222 expref: 32 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.258446:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b000) 00010000:00010000:2.0:1782241284.258448:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782241284.258451:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43face00, rc 0) 00000100:00100000:2.0:1782241284.258546:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+32:11335:x1868815119994880:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 921us (1206us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1782241284.258556:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 103 00000100:00100000:1.0:1782241284.265974:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241284.269733:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119995008 00000100:00100000:2.0:1782241284.270245:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119995008 00000100:00100000:2.0:1782241284.270438:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 104 00000100:00100000:2.0:1782241284.270454:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+32:11335:x1868815119995008:12345-192.168.204.58@tcp:54:lfs.0 00010000:00010000:2.0:1782241284.270578:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19e1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.270603:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19db5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505206 expref: 32 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.270616:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19e1e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.270665:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19db5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505206 expref: 32 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.270708:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19db5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505206 expref: 32 pid: 6510 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241284.270727:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a98700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1868815139995904:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241284.271211:0:6510:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47ac1300 going to sleep for 11 seconds 00000100:00100000:3.0:1782241284.281845:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241284.281965:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119995264 00000100:00100000:0.0:1782241284.281984:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119995264 00000100:00100000:2.0:1782241284.282006:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a98700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1868815139995904:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241284.282040:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19e1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241284.282144:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00100000:0.0:1782241284.282173:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+33:6167:x1868815119995264:12345-192.168.204.58@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782241284.282628:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+34:6167:x1868815119995264:12345-192.168.204.58@tcp:35:ldlm_bl.0 Request processed in 456us (791us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1782241284.282639:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00100000:3.0:1782241284.285043:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241284.285367:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119995392 00000100:00100000:3.0:1782241284.285385:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119995392 00010000:00010000:3.0:1782241284.285427:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19db5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505206 expref: 34 pid: 6510 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241284.286029:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 66 00000100:00100000:3.0:1782241284.286041:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+34:2398:x1868815119995392:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241284.287062:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241284.287076:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19db5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505206 expref: 34 pid: 6510 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.287098:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19db5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505206 expref: 34 pid: 6510 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.287123:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19db5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505206 expref: 34 pid: 6510 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.287141:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b000) 00010000:00010000:3.0:1782241284.287148:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19e1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.287158:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19e1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.287174:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19e1e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.287222:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241284.287257:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19e1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.287268:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19e1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241284.287282:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+33:2398:x1868815119995392:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 1243us (2249us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241284.287292:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 66 00010000:00010000:2.0:1782241284.287309:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19e1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.287318:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19e1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.287324:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19e1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.287330:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241284.287335:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19e1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.287344:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19e1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.287363:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b000) 00010000:00010000:2.0:1782241284.287367:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782241284.287372:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19e1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.287378:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19e1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241284.287423:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+32:11335:x1868815119995008:12345-192.168.204.58@tcp:54:lfs.0 Request processed in 16973us (21463us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241284.287433:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 104 00000100:00100000:3.0:1782241284.294356:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241284.294466:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119995648 00000100:00100000:1.0:1782241284.294486:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119995648 00000100:00100000:1.0:1782241284.295077:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:1.0:1782241284.295091:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+32:11335:x1868815119995648:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:1.0:1782241284.295415:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+33:11335:x1868815119995648:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 326us (1069us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1782241284.295424:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:3.0:1782241284.430563:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241284.430707:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119995904 00000100:00100000:2.0:1782241284.430718:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119995904 00000100:00100000:2.0:1782241284.430955:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 105 00000100:00100000:2.0:1782241284.430966:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+33:11346:x1868815119995904:12345-192.168.204.58@tcp:101:cat.0 00010000:00010000:2.0:1782241284.430994:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241284.431119:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505229 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431236:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e2c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431253:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431266:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431282:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431297:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431304:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431415:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19e3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431424:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19e3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431431:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19e3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241284.431442:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1782241284.431517:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431524:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e2c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431530:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431535:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241284.431540:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431546:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e2c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431570:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:2.0:1782241284.431572:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241284.431578:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431584:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431595:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431602:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431607:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431613:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241284.431617:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431621:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431627:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890d4781b200) 00010000:00010000:2.0:1782241284.431629:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241284.431632:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431637:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431686:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505229 expref: 36 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431700:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19e3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505229 expref: 35 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.431707:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b000) 00010000:00010000:2.0:1782241284.431709:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241284.431711:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fadc00, rc 0) 00000100:00100000:2.0:1782241284.436673:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+35:11346:x1868815119995904:12345-192.168.204.58@tcp:101:cat.0 Request processed in 5694us (6106us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1782241284.436686:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 105 00000100:00100000:2.0:1782241284.452009:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241284.452247:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119996160 00000100:00100000:1.0:1782241284.452258:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119996160 00000100:00100000:1.0:1782241284.452317:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:1.0:1782241284.452328:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+35:11346:x1868815119996160:12345-192.168.204.58@tcp:35:cat.0 00000100:00100000:1.0:1782241284.452630:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+36:11346:x1868815119996160:12345-192.168.204.58@tcp:35:cat.0 Request processed in 302us (635us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1782241284.452638:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:1.0:1782241284.508854:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241284.508927:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241284.508966:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241284.509065:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119996288 00000100:00100000:3.0:1782241284.509075:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119996288 00000100:00100000:3.0:1782241284.509142:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 380 00000100:00100000:3.0:1782241284.509153:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815119996288:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241284.509220:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815119996288:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 70us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241284.509228:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 380 00000100:00100000:0.0:1782241284.509349:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119996416 00000100:00100000:0.0:1782241284.509353:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119996416 00000100:00100000:0.0:1782241284.509395:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119996672 00000100:00100000:0.0:1782241284.509397:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119996672 00000100:00100000:0.0:1782241284.509420:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 276 00000100:00100000:0.0:1782241284.509426:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119996416:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241284.509455:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2398:x1868815119996416:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 30us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241284.509461:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 276 00000100:00100000:0.0:1782241284.509474:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 277 00000100:00100000:0.0:1782241284.509479:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119996672:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241284.509497:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119996672:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 18us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241284.509504:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 277 00000100:00080000:3.0:1782241284.509962:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782241284.509967:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782241284.516921:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241284.516970:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241284.516995:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241284.517596:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119996544 00000100:00100000:1.0:1782241284.517606:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119996544 00000100:00100000:1.0:1782241284.517667:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 110 00000100:00100000:1.0:1782241284.517677:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2398:x1868815119996544:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241284.517743:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2398:x1868815119996544:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 68us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241284.517750:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 110 00000100:00080000:3.0:1782241284.518327:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241284.518547:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119996800 00000100:00100000:2.0:1782241284.518554:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119996800 00000100:00100000:2.0:1782241284.518609:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119997056 00000100:00100000:2.0:1782241284.518613:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119997056 00000100:00100000:2.0:1782241284.518636:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 278 00000100:00100000:2.0:1782241284.518643:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119996800:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241284.518691:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2398:x1868815119996800:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 48us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241284.518698:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 278 00000100:00100000:2.0:1782241284.518716:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 106 00000100:00100000:2.0:1782241284.518722:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+36:11347:x1868815119997056:12345-192.168.204.58@tcp:36:rm.0 00010000:00010000:2.0:1782241284.518819:0:10147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1782241284.518871:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19dd8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505214 expref: 36 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.518896:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19e3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505229 expref: 35 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.518908:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505222 expref: 34 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.518921:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e19dca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350520d expref: 33 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.518931:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b000) 00010000:00010000:2.0:1782241284.518937:0:10147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241284.518971:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e48 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.518984:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.518994:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.519007:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e4f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.519014:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.519019:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.519112:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782241284.519212:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1782241284.519602:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.519613:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782241284.520993:0:10147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1782241284.521009:0:10147:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347779251359ns, next at 348779247599ns, rc = 0 00010000:00010000:2.0:1782241284.521080:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521094:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521106:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521116:0:10147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e5d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521134:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e5d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521140:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e5d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521165:0:10147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782241284.521186:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521205:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e56 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521212:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521218:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fade00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241284.521223:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521231:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e56 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521243:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b000) 00010000:00010000:2.0:1782241284.521246:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782241284.521250:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e56 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521256:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e56 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521274:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521279:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e48 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521286:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e48 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521291:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241284.521300:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e48 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521307:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e48 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521316:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:2.0:1782241284.521319:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241284.521321:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e48 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521328:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e48 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782241284.521339:0:10147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af439c22 reply state 000000008cfdf850 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e4f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521350:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e4f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.521356:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890d4781b200) 00010000:00010000:2.0:1782241284.521358:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782241284.521361:0:10147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782241284.521455:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+34:11347:x1868815119997056:12345-192.168.204.58@tcp:36:rm.0 Request processed in 2728us (4453us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1782241284.521465:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 106 00010000:00010000:0.0:1782241284.524674:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241284.524690:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e5d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.524703:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241284.524708:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e5d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.524719:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e5d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.524812:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b000) 00010000:00010000:0.0:1782241284.524816:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782241284.524821:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e5d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.524828:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19e5d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.524848:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241284.524850:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241284.524852:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241284.602493:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241284.602609:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119997312 00000100:00100000:2.0:1782241284.602622:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119997312 00000100:00100000:2.0:1782241284.602689:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 107 00000100:00100000:2.0:1782241284.602699:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+34:11353:x1868815119997312:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:2.0:1782241284.602726:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241284.602815:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e64 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505230 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.602922:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e6b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.602948:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.602960:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.602972:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e72 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.602979:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.602985:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782241284.603509:0:6510:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1782241284.603653:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19e79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.603663:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19e79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.603671:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19e79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.603706:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.603725:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e6b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.603732:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e6b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.603738:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fade00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241284.603743:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e6b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.603750:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e6b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.604074:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:2.0:1782241284.604079:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241284.604083:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e6b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.604090:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19e6b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782241284.604103:0:6510:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b6346a64 reply state 00000000ba0f75ed transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.604114:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.604183:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890d4781b200) 00010000:00010000:2.0:1782241284.604186:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782241284.604188:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782241284.604219:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19e64 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505230 expref: 37 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.604240:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19e79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505230 expref: 36 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.604247:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4781bd00) 00010000:00010000:2.0:1782241284.604249:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241284.604252:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fadc00, rc 0) 00000100:00100000:2.0:1782241284.604352:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+37:11353:x1868815119997312:12345-192.168.204.58@tcp:101:bash.0 Request processed in 1654us (1869us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1782241284.604361:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 107 00000100:00100000:1.0:1782241284.612891:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241284.612986:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119997440 00000100:00100000:3.0:1782241284.612995:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119997440 00000100:00100000:3.0:1782241284.613065:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 42 00000100:00100000:3.0:1782241284.613076:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2399:x1868815119997440:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:3.0:1782241284.613098:0:8746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241284.613123:0:8746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19e87 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505237 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782241284.613176:0:8746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241284.613198:0:8746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=347s v=(0 0) 00010000:00010000:3.0:1782241284.613202:0:8746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241284.613212:0:8746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19e87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505237 expref: 8 pid: 8746 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.613232:0:8746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19e87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505237 expref: 8 pid: 8746 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.613246:0:8746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164ce00, rc 0) 00000100:00100000:3.0:1782241284.613311:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2399:x1868815119997440:12345-192.168.204.58@tcp:101:bash.0 Request processed in 236us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241284.613318:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 42 00000100:00100000:3.0:1782241284.619134:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241284.619280:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119997568 00000100:00100000:0.0:1782241284.619290:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119997568 00000100:00100000:0.0:1782241284.619361:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 43 00000100:00100000:0.0:1782241284.619373:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:11353:x1868815119997568:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:0.0:1782241284.619392:0:8747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241284.619413:0:8747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350523e expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.619446:0:8747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19e87 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505237 expref: 9 pid: 8746 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.619469:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241284.619474:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241284.619480:0:8747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350523e expref: 9 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.619518:0:8747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19e87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505237 expref: 9 pid: 8746 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.619547:0:8747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19e87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505237 expref: 9 pid: 8746 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241284.619562:0:8747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e51ae1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:8747:1868815139996032:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241284.619679:0:8747:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77963d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782241284.626436:0:8747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e51ae1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:8747:1868815139996032:192.168.204.58@tcp:104: 00010000:00010000:0.0:1782241284.626491:0:8747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350523e expref: 9 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.626515:0:8747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1e00, rc 0) 00000100:00100000:0.0:1782241284.626576:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:11353:x1868815119997568:12345-192.168.204.58@tcp:101:bash.0 Request processed in 7205us (7462us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241284.626585:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 43 00000100:00100000:3.0:1782241284.629106:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241284.629333:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119997696 00000100:00100000:1.0:1782241284.629343:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119997696 00010000:00010000:1.0:1782241284.629389:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19e87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505237 expref: 9 pid: 8746 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241284.629435:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 67 00000100:00100000:1.0:1782241284.629446:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2399:x1868815119997696:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241284.629473:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241284.629496:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19e87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505237 expref: 9 pid: 8746 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.629511:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19e87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505237 expref: 9 pid: 8746 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.629537:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e19e87 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505237 expref: 9 pid: 8746 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.629570:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241284.629574:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241284.629583:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350523e expref: 8 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.629593:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350523e expref: 8 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.629633:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350523e expref: 8 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241284.629647:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d476ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6496:1868815139996160:192.168.204.58@tcp:105: 00000100:00100000:1.0:1782241284.629739:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4b13b000 going to sleep for 11 seconds 00000100:00100000:0.0:1782241284.636216:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241284.636469:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119997952 00000100:00100000:3.0:1782241284.636478:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119997952 00000100:00100000:3.0:1782241284.636537:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:3.0:1782241284.636546:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+37:11353:x1868815119997952:12345-192.168.204.58@tcp:35:bash.0 00000001:00080000:3.0:1782241284.636816:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967379 00000100:00100000:3.0:1782241284.636919:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+39:11353:x1868815119997952:12345-192.168.204.58@tcp:35:bash.0 Request processed in 373us (714us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1782241284.636927:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 25 00000020:00080000:3.0:1782241284.636932:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782241284.641017:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d476ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6496:1868815139996160:192.168.204.58@tcp:105: 00010000:00010000:1.0:1782241284.641047:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241284.642445:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2399:x1868815119997696:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 12992us (13341us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241284.642858:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 67 00010000:00010000:1.0:1782241284.747329:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241284.910695:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241284.912171:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119998080 00000100:00100000:1.0:1782241284.912184:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119998080 00000100:00100000:1.0:1782241284.912259:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 108 00000100:00100000:1.0:1782241284.912271:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+39:11369:x1868815119998080:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241284.912296:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241284.912330:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19e95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505245 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.912398:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19e9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.912412:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.912423:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241284.912469:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1782241284.912473:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241284.912503:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.912528:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e19e95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505245 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.912546:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19e9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505245 expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.912555:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:1.0:1782241284.912558:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782241284.912561:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea800, rc 0) 00000100:00100000:1.0:1782241284.913095:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+40:11369:x1868815119998080:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 362us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241284.913104:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 108 00000100:00100000:2.0:1782241284.916667:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241284.916846:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119998336 00000100:00100000:0.0:1782241284.916859:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119998336 00000100:00100000:0.0:1782241284.916926:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 109 00000100:00100000:0.0:1782241284.916959:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+40:11369:x1868815119998336:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241284.916983:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241284.917004:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19ea3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350524c expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.917128:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e19eaa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.917158:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e19eaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.917170:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e19eaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241284.917182:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1782241284.917290:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e19ea3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350524c expref: 43 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.917309:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e19eaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350524c expref: 42 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.917318:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4781bd00) 00010000:00010000:0.0:1782241284.917321:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782241284.917325:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1000, rc 0) 00000100:00100000:0.0:1782241284.917387:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+42:11369:x1868815119998336:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 453us (730us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1782241284.917395:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 109 00000100:00100000:2.0:1782241284.921959:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241284.922017:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241284.922175:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119998720 00000100:00100000:3.0:1782241284.922186:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119998720 00000100:00100000:3.0:1782241284.922255:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 110 00000100:00100000:3.0:1782241284.922271:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+42:11369:x1868815119998720:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241284.922295:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241284.922313:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19eb8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505253 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.922417:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19ebf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.922432:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19ebf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.922444:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19ebf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241284.922458:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1782241284.922570:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19eb8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505253 expref: 45 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.922589:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19ebf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505253 expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.922598:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4781bd00) 00010000:00010000:3.0:1782241284.922601:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1782241284.922605:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164dc00, rc 0) 00000100:00100000:3.0:1782241284.922865:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+44:11369:x1868815119998720:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 594us (845us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1782241284.922873:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 110 00000100:00100000:1.0:1782241284.922987:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119998464 00000100:00100000:1.0:1782241284.922999:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119998464 00000100:00100000:1.0:1782241284.923054:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:1.0:1782241284.923063:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47853b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+44:2397:x1868815119998464:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241284.923073:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241284.923088:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e19eaa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350524c expref: 44 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.923101:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4781bd00) 00010000:00010000:1.0:1782241284.923104:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241284.923126:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47853b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+43:2397:x1868815119998464:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 66us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241284.923134:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:1.0:1782241284.937058:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241284.937366:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119998848 00000100:00100000:0.0:1782241284.937377:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119998848 00000100:00100000:0.0:1782241284.937441:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 44 00000100:00100000:0.0:1782241284.937452:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2398:x1868815119998848:12345-192.168.204.58@tcp:1:lfs.0 00010000:00010000:0.0:1782241284.937512:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dafabb40/0xc9959f2fb1e19ecd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.937533:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350523e expref: 8 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.937555:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782241284.937559:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782241284.937563:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dafabb40/0xc9959f2fb1e19ecd lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.937598:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350523e expref: 8 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.937611:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350523e expref: 8 pid: 8747 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241284.937638:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e51ae1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8423:1868815139996288:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241284.937744:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e779636c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241284.941515:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241284.941593:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119998976 00000100:00100000:3.0:1782241284.941602:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119998976 00002000:00100000:3.0:1782241284.941659:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff890d476ec000 x1868815119998976/t0(0) o4->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:375/0 lens 504/0 e 0 to 0 dl 1782241295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782241284.941671:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d476ec000 with x1868815119998976 ext(0->8) 00010000:00010000:3.0:1782241284.941680:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350523e expref: 9 pid: 8747 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.941696:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350523e expref: 9 pid: 8747 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782241284.941703:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff890d476ec000 00000100:00100000:3.0:1782241284.941733:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 1 00000100:00100000:3.0:1782241284.941741:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2399:x1868815119998976:12345-192.168.204.58@tcp:4:lfs.0 00000100:00100000:3.0:1782241284.943796:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:2399:x1868815119998976:12345-192.168.204.58@tcp:4:lfs.0 Request processed in 2045us (2280us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1782241284.943810:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 1 00002000:00100000:3.0:1782241284.943822:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff890d476ec000 x1868815119998976/t4294967303(0) o4->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:375/0 lens 504/448 e 0 to 0 dl 1782241295 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782241284.943832:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d476ec000 with x1868815119998976 ext(0->8) 00010000:00010000:3.0:1782241284.943843:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350523e expref: 11 pid: 8747 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.943861:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350523e expref: 11 pid: 8747 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782241284.943887:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff890d476ec000 00000100:00100000:0.0:1782241284.944481:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e51ae1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8423:1868815139996288:192.168.204.58@tcp:104: 00010000:00010000:0.0:1782241284.944506:0:8423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dafabb40/0xc9959f2fb1e19ecd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241284.956534:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241284.956912:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119999104 00000100:00100000:3.0:1782241284.956923:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119999104 00010000:00010000:3.0:1782241284.956982:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350523e expref: 11 pid: 8747 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241284.957029:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 68 00000100:00100000:3.0:1782241284.957039:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e477c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:2399:x1868815119999104:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241284.957054:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1782241284.957073:0:10331:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782241284.957076:0:10331:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1782241285 00002000:00010000:3.0:1782241284.957078:0:10331:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1782241285 00002000:00010000:3.0:1782241284.957081:0:10331:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1782241285 00002000:00010000:3.0:1782241284.957083:0:10331:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1782241284.957088:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350523e expref: 11 pid: 8747 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.957103:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350523e expref: 11 pid: 8747 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.957138:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aff20242/0xc9959f2fb1e19e8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350523e expref: 11 pid: 8747 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.957155:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782241284.957159:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782241284.957178:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dafabb40/0xc9959f2fb1e19ecd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.957188:0:10331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dafabb40/0xc9959f2fb1e19ecd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241284.957227:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241284.957274:0:8423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dafabb40/0xc9959f2fb1e19ecd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.957284:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dafabb40/0xc9959f2fb1e19ecd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241284.957288:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e477c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+10:2399:x1868815119999104:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 250us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241284.957296:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 68 00010000:00010000:1.0:1782241284.957305:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dafabb40/0xc9959f2fb1e19ecd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.957312:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dafabb40/0xc9959f2fb1e19ecd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.957320:0:8423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dafabb40/0xc9959f2fb1e19ecd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.957334:0:8423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241284.957338:0:8423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dafabb40/0xc9959f2fb1e19ecd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.957348:0:8423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dafabb40/0xc9959f2fb1e19ecd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.957360:0:8423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dafabb40/0xc9959f2fb1e19ecd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.957368:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dafabb40/0xc9959f2fb1e19ecd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241284.957414:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2398:x1868815119998848:12345-192.168.204.58@tcp:1:lfs.0 Request processed in 19964us (20365us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241284.957422:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 44 00000100:00100000:2.0:1782241284.964916:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241284.965789:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119999360 00000100:00100000:3.0:1782241284.965801:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119999360 00000100:00100000:3.0:1782241284.965877:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 26 00000100:00100000:3.0:1782241284.965889:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47a48850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+43:11369:x1868815119999360:12345-192.168.204.58@tcp:35:lfs.0 00000004:00010000:3.0:1782241284.966314:0:6514:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19ebf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505253 expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782241284.967136:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1782241284.967187:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:2.0:1782241284.967485:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:2.0:1782241284.967523:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19ed4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.967539:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19e79 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505230 expref: 47 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.967548:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19ed4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.967581:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19e79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505230 expref: 47 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241284.967603:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19e79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505230 expref: 47 pid: 6510 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241284.967618:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47853480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1868815139996416:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241284.967711:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47934240 going to sleep for 11 seconds 00000100:00100000:2.0:1782241284.973820:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241284.973950:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47853480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1868815139996416:192.168.204.58@tcp:104: 00010000:00010000:0.0:1782241284.973979:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19ed4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241284.974191:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119999488 00000100:00100000:1.0:1782241284.974199:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119999488 00010000:00010000:1.0:1782241284.974236:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19e79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505230 expref: 48 pid: 6510 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241284.974276:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 69 00000100:00100000:1.0:1782241284.974285:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47850a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+48:2398:x1868815119999488:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241284.974300:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241284.974307:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19e79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505230 expref: 48 pid: 6510 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.974338:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19e79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505230 expref: 48 pid: 6510 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.974361:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19e79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505230 expref: 48 pid: 6510 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.974376:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4781bd00) 00010000:00010000:1.0:1782241284.974381:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19ed4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.974390:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19ed4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.974397:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19ed4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241284.974427:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241284.974485:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47850a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+47:2398:x1868815119999488:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 200us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241284.974493:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 69 00010000:00010000:0.0:1782241284.974857:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19ed4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.974865:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19ed4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782241284.975004:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:0.0:1782241284.975125:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1782241284.975229:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e51ae1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1868815139996544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782241284.975277:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241284.975317:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77963d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241284.975599:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139996544 00000100:00100000:1.0:1782241284.975606:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139996544 00000100:00100000:1.0:1782241284.975661:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782241284.975670:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6514:x1868815139996544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782241284.975752:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6514:x1868815139996544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 83us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241284.975778:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782241284.975875:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e51ae1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1868815139996544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782241284.975998:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:0.0:1782241284.976040:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e51ae1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1868815139996672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782241284.976083:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241284.976128:0:6514:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47bfccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241284.976706:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139996672 00000100:00100000:1.0:1782241284.976711:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139996672 00000100:00100000:1.0:1782241284.976747:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782241284.976786:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6514:x1868815139996672:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782241284.976905:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6514:x1868815139996672:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 150us (820us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1782241284.976911:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1782241284.976977:0:6514:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e51ae1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1868815139996672:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782241284.977021:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1782241284.977054:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19ed4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.977064:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19ed4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.977071:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19ed4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.977077:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241284.977081:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19ed4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.977088:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19ed4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.977127:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4781bd00) 00010000:00010000:0.0:1782241284.977130:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1782241284.977136:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19ed4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.977155:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19ed4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782241284.977249:0:6514:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1782241284.977311:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1782241284.977323:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348235565299ns, next at 349235563137ns, rc = 0 00000001:00080000:0.0:1782241284.977329:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:0.0:1782241284.977350:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4781bd00) 00010000:00010000:0.0:1782241284.977353:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782241284.977359:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e19ebf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505253 expref: 51 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241284.977458:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47a48850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+50:11369:x1868815119999360:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 11571us (12552us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1782241284.977468:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 26 00000020:00080000:0.0:1782241284.977472:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1782241284.985845:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241284.985947:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119999616 00000100:00100000:0.0:1782241284.985959:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119999616 00000100:00100000:0.0:1782241284.986030:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 111 00000100:00100000:0.0:1782241284.986042:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+50:11369:x1868815119999616:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241284.986069:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241284.986094:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19edb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350525a expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.986191:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19edb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350525a expref: 51 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.986207:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19edb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350525a expref: 51 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241284.986228:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:0.0:1782241284.986232:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782241284.986235:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0200, rc 0) 00000100:00100000:0.0:1782241284.986305:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+51:11369:x1868815119999616:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 265us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241284.986313:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 111 00000100:00100000:2.0:1782241284.995750:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241284.996002:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815119999872 00000100:00100000:0.0:1782241284.996014:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815119999872 00000100:00100000:0.0:1782241284.996088:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 27 00000100:00100000:0.0:1782241284.996100:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+51:11369:x1868815119999872:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:0.0:1782241284.996603:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+52:11369:x1868815119999872:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 504us (862us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1782241284.996612:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 27 00000100:00100000:1.0:1782241285.158592:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241285.158780:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120000000 00000100:00100000:3.0:1782241285.158791:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120000000 00000100:00100000:3.0:1782241285.158854:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 112 00000100:00100000:3.0:1782241285.158865:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+52:11379:x1868815120000000:12345-192.168.204.58@tcp:34:lfs.0 00010000:00010000:3.0:1782241285.158958:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19ee2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.158975:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.158987:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159011:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ee9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159019:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159026:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159115:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19ef0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159124:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159131:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782241285.159407:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159420:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159427:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19ee2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159433:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159439:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241285.159443:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159458:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19ee2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159471:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:3.0:1782241285.159474:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241285.159540:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19ee2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159547:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19ee2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159562:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159568:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ee9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159574:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159579:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241285.159582:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159587:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159596:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890d4781b200) 00010000:00010000:3.0:1782241285.159598:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241285.159601:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ee9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159617:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19ee9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159627:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159633:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19ef0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159638:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159643:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164de00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241285.159646:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159653:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159661:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:3.0:1782241285.159664:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241285.159667:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19ef0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.159673:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19ef0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241285.159826:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+52:11379:x1868815120000000:12345-192.168.204.58@tcp:34:lfs.0 Request processed in 962us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241285.159834:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 112 00000100:00100000:3.0:1782241285.246544:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241285.247387:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120000256 00000100:00100000:2.0:1782241285.247398:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120000256 00000100:00100000:2.0:1782241285.247527:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 113 00000100:00100000:2.0:1782241285.247540:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+52:11382:x1868815120000256:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241285.247565:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241285.247586:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19ef7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505261 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.247673:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19efe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.247688:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19efe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.247699:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19efe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.247710:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.247736:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.247744:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.247903:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19f0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.247912:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19f0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.247920:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19f0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241285.247941:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1782241285.248018:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19efe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.248026:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19efe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.248034:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19efe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.248040:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241285.248045:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19efe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.248053:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19efe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.248077:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:2.0:1782241285.248080:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241285.248085:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19efe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.248092:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19efe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.248115:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.248121:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.248126:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.248131:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241285.248134:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.249566:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.249582:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890d4781b200) 00010000:00010000:2.0:1782241285.249585:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241285.249590:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f05 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.249597:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.249669:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19ef7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505261 expref: 55 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.249685:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19f0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505261 expref: 54 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.249693:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:2.0:1782241285.249695:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241285.249699:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fade00, rc 0) 00000100:00100000:2.0:1782241285.249797:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+54:11382:x1868815120000256:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 2258us (3263us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1782241285.249809:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 113 00000100:00100000:3.0:1782241285.257057:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241285.260236:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120000384 00000100:00100000:0.0:1782241285.260252:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120000384 00000100:00100000:2.0:1782241285.260390:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 114 00000100:00100000:2.0:1782241285.260404:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+54:11382:x1868815120000384:12345-192.168.204.58@tcp:54:lfs.0 00010000:00010000:2.0:1782241285.260476:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.260492:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.260503:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.260541:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.260547:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.260568:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.260573:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fadc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241285.260578:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.260585:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.260598:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:2.0:1782241285.260602:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782241285.260607:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f1a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.260613:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241285.263476:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+54:11382:x1868815120000384:12345-192.168.204.58@tcp:54:lfs.0 Request processed in 3064us (6417us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241285.263491:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 114 00000100:00100000:3.0:1782241285.266147:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241285.266296:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120000640 00000100:00100000:1.0:1782241285.266307:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120000640 00000100:00100000:1.0:1782241285.266378:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 28 00000100:00100000:1.0:1782241285.266389:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+54:11382:x1868815120000640:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:1.0:1782241285.266631:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+55:11382:x1868815120000640:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 231us (481us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1782241285.266640:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 28 00000100:00100000:2.0:1782241285.382006:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782241285.382032:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139996800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782241285.382103:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241285.382487:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139996800 00000100:00100000:0.0:1782241285.382495:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139996800 00000100:00100000:0.0:1782241285.382559:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1782241285.382569:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139996800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241285.382624:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1782241285.382701:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139996800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241285.382709:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1782241285.382753:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139996800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241285.412907:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241285.413074:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120000896 00000100:00100000:2.0:1782241285.413083:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120000896 00000100:00100000:2.0:1782241285.413149:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 115 00000100:00100000:2.0:1782241285.413160:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+55:11392:x1868815120000896:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:2.0:1782241285.413186:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241285.413203:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782241285.413231:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e19e9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505245 expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.413248:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:2.0:1782241285.413253:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241285.413265:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f21 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505268 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.413367:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.413382:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.413392:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241285.413403:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1782241285.413505:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f21 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505268 expref: 57 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.413520:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505268 expref: 56 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.413528:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:2.0:1782241285.413531:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241285.413534:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad600, rc 0) 00000100:00100000:2.0:1782241285.413606:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+56:11392:x1868815120000896:12345-192.168.204.58@tcp:101:bash.0 Request processed in 447us (709us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1782241285.413623:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 115 00000100:00100000:1.0:1782241285.422118:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241285.422181:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241285.422287:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120001152 00000100:00100000:2.0:1782241285.422298:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120001152 00000100:00100000:2.0:1782241285.422357:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 116 00000100:00100000:2.0:1782241285.422366:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+56:11392:x1868815120001152:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:2.0:1782241285.422391:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241285.422409:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350526f expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.422444:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.422457:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.422468:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.422607:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350526f expref: 58 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.422625:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350526f expref: 57 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.422635:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:2.0:1782241285.422637:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782241285.422641:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fac200, rc 0) 00000100:00100000:2.0:1782241285.422706:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+57:11392:x1868815120001152:12345-192.168.204.58@tcp:101:bash.0 Request processed in 340us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241285.422720:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 116 00000100:00100000:0.0:1782241285.423495:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120001024 00000100:00100000:0.0:1782241285.423503:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120001024 00000100:00100000:0.0:1782241285.423554:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 8 00000100:00100000:0.0:1782241285.423577:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+57:2397:x1868815120001024:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241285.423588:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241285.423606:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505268 expref: 57 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241285.423621:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:0.0:1782241285.423624:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241285.423666:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+56:2397:x1868815120001024:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 91us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241285.423673:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 8 00000100:00100000:1.0:1782241285.436890:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241285.437688:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120001408 00000100:00100000:2.0:1782241285.437700:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120001408 00000100:00100000:2.0:1782241285.437800:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 117 00000100:00100000:2.0:1782241285.437817:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+56:11392:x1868815120001408:12345-192.168.204.58@tcp:36:bash.0 00010000:00010000:2.0:1782241285.437876:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241285.437905:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19f0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505261 expref: 56 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.437935:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:2.0:1782241285.437940:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241285.438097:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.438111:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.438121:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782241285.438160:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:2.0:1782241285.438182:0:6510:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f87c8517 reply state 00000000be90129f transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.438194:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.438199:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:2.0:1782241285.438202:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782241285.438214:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782241285.438305:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+58:11392:x1868815120001408:12345-192.168.204.58@tcp:36:bash.0 Request processed in 496us (1425us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1782241285.438312:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 117 00000020:00080000:2.0:1782241285.438317:0:6510:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782241285.444513:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241285.444695:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120001536 00000100:00100000:2.0:1782241285.444704:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120001536 00000100:00100000:2.0:1782241285.444841:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 118 00000100:00100000:2.0:1782241285.444853:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+58:11392:x1868815120001536:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:2.0:1782241285.444879:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241285.444903:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19f4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505276 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.445005:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19f52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.445021:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19f52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.445034:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19f52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241285.445129:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1782241285.445134:0:10147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241285.445155:0:10147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19f52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.445181:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e19f4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505276 expref: 60 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.445194:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19f52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505276 expref: 59 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.445216:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:1.0:1782241285.445219:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241285.445222:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad400, rc 0) 00000100:00100000:1.0:1782241285.445286:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:11392:x1868815120001536:12345-192.168.204.58@tcp:101:bash.0 Request processed in 437us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241285.445293:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 118 00000100:00100000:3.0:1782241285.455468:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241285.455583:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120001792 00000100:00100000:1.0:1782241285.455596:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120001792 00000100:00100000:1.0:1782241285.455657:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00100000:1.0:1782241285.455666:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:11392:x1868815120001792:12345-192.168.204.58@tcp:35:bash.0 00000100:00100000:1.0:1782241285.455959:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:11392:x1868815120001792:12345-192.168.204.58@tcp:35:bash.0 Request processed in 293us (498us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1782241285.455967:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00100000:3.0:1782241285.568644:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241285.568789:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120001920 00000100:00100000:1.0:1782241285.568800:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120001920 00000100:00100000:1.0:1782241285.568864:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 119 00000100:00100000:1.0:1782241285.568875:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:11398:x1868815120001920:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241285.568898:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241285.568929:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19f59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350527d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.568998:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19f60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.569012:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.569037:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241285.569085:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1782241285.569089:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241285.569108:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.569133:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19f59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350527d expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.569153:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19f60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350527d expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.569162:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:1.0:1782241285.569165:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782241285.569168:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb200, rc 0) 00000100:00100000:1.0:1782241285.569253:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+61:11398:x1868815120001920:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 380us (2498us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241285.569261:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 119 00000100:00100000:2.0:1782241285.577056:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241285.578946:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120002048 00000100:00100000:3.0:1782241285.578962:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120002048 00000100:00100000:3.0:1782241285.579042:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 120 00000100:00100000:3.0:1782241285.579054:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+61:11398:x1868815120002048:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241285.579078:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241285.579113:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19f67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505284 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579183:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19f6e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579198:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19f6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579210:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19f6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579222:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19f75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579228:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19f75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579235:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19f75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579323:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19f7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579332:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19f7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579352:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19f7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241285.579391:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1782241285.579395:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782241285.579411:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19f7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579421:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19f7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579429:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19f6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579436:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19f6e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579443:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19f6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579449:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241285.579453:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19f6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579460:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19f6e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579480:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:3.0:1782241285.579484:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241285.579489:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19f6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579495:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19f6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579508:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19f75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579514:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19f75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579519:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19f75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579524:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241285.579527:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19f75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579533:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19f75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579540:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890d4781b200) 00010000:00010000:3.0:1782241285.579543:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241285.579546:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19f75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579551:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19f75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579723:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19f67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505284 expref: 63 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579738:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19f7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505284 expref: 62 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.579745:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:3.0:1782241285.579748:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782241285.579751:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164da00, rc 0) 00000100:00100000:3.0:1782241285.579857:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+62:11398:x1868815120002048:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 805us (2810us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241285.579866:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 120 00000100:00100000:0.0:1782241285.588139:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241285.588201:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241285.588293:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120002432 00000100:00100000:1.0:1782241285.588293:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120002304 00000100:00100000:2.0:1782241285.588305:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120002432 00000100:00100000:1.0:1782241285.588305:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120002304 00000100:00100000:1.0:1782241285.588379:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 121 00000100:00100000:2.0:1782241285.588383:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00100000:1.0:1782241285.588394:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:11398:x1868815120002304:12345-192.168.204.58@tcp:101:lfs.0 00000100:00100000:2.0:1782241285.588396:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:2398:x1868815120002432:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241285.588416:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241285.588416:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241285.588441:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e19f7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505284 expref: 63 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.588450:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19f83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350528b expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.588483:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:2.0:1782241285.588490:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241285.588551:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:2398:x1868815120002432:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 158us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241285.588559:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 9 00010000:00010000:1.0:1782241285.588579:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e19f8a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.588595:0:10147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19f52 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505276 expref: 62 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.588604:0:10147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e19f8a lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.588638:0:10147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19f52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505276 expref: 62 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.588653:0:10147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19f52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505276 expref: 62 pid: 10147 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241285.588667:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815139996928:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241285.588751:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d468696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241285.596262:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241285.596335:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120002560 00000100:00100000:3.0:1782241285.596343:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120002560 00010000:00010000:3.0:1782241285.596379:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19f52 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505276 expref: 63 pid: 10147 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241285.596416:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 70 00000100:00100000:3.0:1782241285.596424:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:2399:x1868815120002560:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241285.596438:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241285.596444:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19f52 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505276 expref: 63 pid: 10147 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.596458:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19f52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505276 expref: 63 pid: 10147 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.596495:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:3.0:1782241285.596500:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e19f8a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.596509:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e19f8a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.596517:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e19f8a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.596532:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241285.596594:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:2399:x1868815120002560:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 170us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241285.596601:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 70 00010000:00010000:1.0:1782241285.597350:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e19f52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505276 expref: 62 pid: 10147 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241285.597367:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815139996928:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241285.597389:0:10147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e19f8a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.597398:0:10147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e19f8a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.597418:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e19f8a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241285.597437:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1782241285.598003:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e19f83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350528b expref: 63 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.598021:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e19f8a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350528b expref: 62 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241285.598029:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:1.0:1782241285.598032:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782241285.598035:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ebe00, rc 0) 00000100:00100000:1.0:1782241285.598138:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+62:11398:x1868815120002304:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 9747us (10009us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1782241285.598146:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 121 00000100:00100000:0.0:1782241285.608153:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241285.608248:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120002816 00000100:00100000:3.0:1782241285.608258:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120002816 00000100:00100000:3.0:1782241285.608320:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00100000:3.0:1782241285.608329:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+62:11398:x1868815120002816:12345-192.168.204.58@tcp:103:lfs.0 00010000:00010000:3.0:1782241285.608343:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241285.608368:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e19edb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350525a expref: 62 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.608385:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:3.0:1782241285.608390:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241285.608456:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+61:11398:x1868815120002816:12345-192.168.204.58@tcp:103:lfs.0 Request processed in 127us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241285.608465:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00100000:3.0:1782241285.611054:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241285.611145:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120002944 00000100:00100000:2.0:1782241285.611153:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120002944 00000100:00100000:2.0:1782241285.611215:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 122 00000100:00100000:2.0:1782241285.611227:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+61:11398:x1868815120002944:12345-192.168.204.58@tcp:58:lfs.0 00010000:00010000:2.0:1782241285.611331:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f98 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.611346:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241285.611357:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782241285.611451:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1782241285.611533:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+61:11398:x1868815120002944:12345-192.168.204.58@tcp:58:lfs.0 Request processed in 309us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241285.611541:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 122 00000100:00100000:0.0:1782241285.615653:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241285.615946:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120003072 00000100:00100000:3.0:1782241285.615957:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120003072 00000100:00100000:3.0:1782241285.616019:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 123 00000100:00100000:3.0:1782241285.616029:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+61:11398:x1868815120003072:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241285.616050:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241285.616072:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19f9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505292 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.616140:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f98 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.616152:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19f9f lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505292 expref: 62 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.616170:0:6510:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.616183:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19f9f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505292 expref: 62 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.616195:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:3.0:1782241285.616198:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782241285.616200:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19f9f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505292 expref: 62 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241285.616207:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164de00, rc 0) 00000100:00100000:3.0:1782241285.616267:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+62:11398:x1868815120003072:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 240us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241285.616291:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 123 00010000:00010000:3.0:1782241285.765301:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241286.405257:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139997312:0@lo:400:kworker.0 00000100:00100000:2.0:1782241286.405337:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241286.405401:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139997824:0@lo:400:kworker.0 00000100:00100000:2.0:1782241286.405425:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241286.405464:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782241286.405471:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139997440:0@lo:400:kworker.0 00000100:00100000:2.0:1782241286.405493:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241286.405510:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139997952:0@lo:400:kworker.0 00000100:00100000:2.0:1782241286.405532:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241286.405566:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139997312 00000100:00100000:2.0:1782241286.405573:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139997312 00000100:00100000:2.0:1782241286.405616:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1782241286.405625:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139997312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241286.405680:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139997312:12345-0@lo:400:kworker.0 Request processed in 54us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241286.405688:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1782241286.405710:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139997952 00000100:00100000:2.0:1782241286.405714:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139997952 00000100:00100000:2.0:1782241286.405747:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782241286.405753:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139997952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241286.405823:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815139997952:12345-0@lo:400:kworker.0 Request processed in 70us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241286.405830:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782241286.405865:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139997952:0@lo:400:kworker.0 00000100:00100000:2.0:1782241286.405876:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815139997312:0@lo:400:kworker.0 00000100:00100000:2.0:1782241286.405900:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139997824 00000100:00100000:2.0:1782241286.405916:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139997824 00000100:00100000:2.0:1782241286.405942:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139997440 00000100:00100000:2.0:1782241286.405944:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139997440 00000100:00100000:2.0:1782241286.405961:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1782241286.405969:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139997824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241286.406011:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815139997824:12345-0@lo:400:kworker.0 Request processed in 43us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241286.406018:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1782241286.406030:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1782241286.406036:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139997440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241286.406063:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815139997440:12345-0@lo:400:kworker.0 Request processed in 27us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241286.406069:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1782241286.406104:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815139997440:0@lo:400:kworker.0 00010000:00080000:2.0:1782241286.406115:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48098000 x1868815139997824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241286.406126:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815139997824:0@lo:400:kworker.0 00000100:00080000:2.0:1782241286.406154:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241286.406158:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241286.406470:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139997184:0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.406504:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241286.406534:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139997696:0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.406555:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241286.406572:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139998208:0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.406593:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241286.406613:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1782241286.406619:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139997056:0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.406645:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241286.406673:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139997568:0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.406696:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241286.406712:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139998080:0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.406731:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241286.406744:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139998592:0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.406786:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241286.406885:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139997056 00000100:00100000:1.0:1782241286.406889:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139997056 00000100:00100000:1.0:1782241286.406933:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1782241286.406941:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815139997056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.406975:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815139997056:12345-0@lo:400:kworker.0 Request processed in 35us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241286.406982:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1782241286.407011:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139998080 00000100:00100000:1.0:1782241286.407015:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139998080 00000100:00100000:1.0:1782241286.407040:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139998592 00000100:00100000:1.0:1782241286.407043:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139998592 00000100:00100000:1.0:1782241286.407063:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782241286.407070:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3638:x1868815139998080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241286.407183:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139997184 00000100:00100000:3.0:1782241286.407188:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139997184 00000100:00100000:3.0:1782241286.407207:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139997696 00000100:00100000:3.0:1782241286.407209:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139997696 00000100:00100000:3.0:1782241286.407222:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139998208 00000100:00100000:3.0:1782241286.407226:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139998208 00000100:00100000:3.0:1782241286.407239:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1782241286.407246:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139997184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241286.407281:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815139997184:12345-0@lo:400:kworker.0 Request processed in 35us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241286.407287:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1782241286.407300:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1782241286.407306:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139997696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241286.407331:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815139997696:12345-0@lo:400:kworker.0 Request processed in 25us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241286.407337:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1782241286.407347:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1782241286.407352:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139998208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241286.407375:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815139998208:12345-0@lo:400:kworker.0 Request processed in 22us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241286.407381:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1782241286.407411:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139997568 00000100:00100000:3.0:1782241286.407415:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139997568 00000100:00100000:3.0:1782241286.407433:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1782241286.407439:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139997568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241286.407479:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815139997568:12345-0@lo:400:kworker.0 Request processed in 39us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241286.407486:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1782241286.407504:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1782241286.407512:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815139998592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241286.407541:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815139998592:12345-0@lo:400:kworker.0 Request processed in 31us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241286.407548:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782241286.407786:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3638:x1868815139998080:12345-0@lo:400:kworker.0 Request processed in 716us (1053us total) trans 0 rc 0/0 00000100:00080000:2.0:1782241286.407897:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782241286.407912:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782241286.407915:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241286.407930:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f6cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139998464:0@lo:400:kworker.0 00000100:00100000:2.0:1782241286.407961:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241286.407990:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782241286.407997:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815139998336:0@lo:400:kworker.0 00000100:00100000:2.0:1782241286.408017:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241286.408042:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139998464 00000100:00100000:2.0:1782241286.408045:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139998464 00000100:00100000:2.0:1782241286.408071:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782241286.408077:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139998464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.408164:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782241286.408201:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815139997056:0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.408213:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139997568:0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.408224:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139998080:0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.408247:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f6cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815139998592:0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.408257:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815139997184:0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.408266:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815139997696:0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.408275:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815139998208:0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.408331:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139998336 00000100:00100000:1.0:1782241286.408335:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139998336 00000100:00100000:1.0:1782241286.408366:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1782241286.408373:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815139998336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241286.408409:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815139998336:12345-0@lo:400:kworker.0 Request processed in 36us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241286.408415:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:1.0:1782241286.408440:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241286.408443:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782241286.408533:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f6cf800 x1868815139998336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241286.408544:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815139998336:0@lo:400:kworker.0 00000100:00100000:2.0:1782241286.408734:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815139998464:12345-0@lo:400:kworker.0 Request processed in 657us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241286.408741:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782241286.409202:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f6cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815139998464:0@lo:400:kworker.0 00000004:00080000:1.0:1782241286.411244:0:9979:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349669485073ns, next at 350669481899ns, rc = 0 00000100:00100000:0.0:1782241286.414993:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241286.415022:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139998720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241286.415103:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241286.415627:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139998720 00000100:00100000:1.0:1782241286.415635:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139998720 00000100:00100000:1.0:1782241286.415733:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1782241286.415743:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815139998720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782241286.415806:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241286.415869:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815139998720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241286.415877:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1782241286.415972:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815139998720:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1782241286.533310:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782241286.533321:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782241286.533360:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1782241286.533370:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782241286.533533:0:13782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1868815139998848:192.168.204.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782241286.533646:0:13782:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e51155840 going to sleep for 11 seconds 00000100:00100000:3.0:1782241286.536825:0:13782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1868815139998848:192.168.204.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782241286.537147:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241286.537228:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120003200 00000100:00100000:3.0:1782241286.537235:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120003200 00000100:00100000:3.0:1782241286.537308:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 124 00000100:00100000:3.0:1782241286.537317:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+62:11399:x1868815120003200:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782241286.537352:0:10147:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782241286.537470:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+62:11399:x1868815120003200:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 Request processed in 152us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241286.537477:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 124 00000100:00080000:1.0:1782241286.537581:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241286.541693:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241286.541829:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120003328 00000100:00100000:1.0:1782241286.541839:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120003328 00000100:00100000:1.0:1782241286.541926:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 125 00000100:00100000:1.0:1782241286.541939:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+62:11399:x1868815120003328:12345-192.168.204.58@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782241286.542015:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e19fa6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542031:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e19fa6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542043:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e19fa6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542057:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19fad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542064:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19fad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542070:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19fad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542109:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19fb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542119:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542126:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241286.542174:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1782241286.542178:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241286.542191:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542211:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e19fa6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542217:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e19fa6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542224:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e19fa6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542230:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241286.542234:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e19fa6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542242:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e19fa6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542255:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890e81fbc300) 00010000:00010000:1.0:1782241286.542258:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241286.542263:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e19fa6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542269:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e19fa6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542282:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19fad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542289:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19fad lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542295:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19fad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542307:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241286.542310:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19fad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542316:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19fad lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542325:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff890e81fbce00) 00010000:00010000:1.0:1782241286.542328:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241286.542331:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19fad lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542337:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19fad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542353:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542359:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19fb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542365:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542370:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ebc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241286.542373:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542379:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19fb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542396:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:1.0:1782241286.542398:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241286.542400:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19fb4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.542406:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19fb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241286.542493:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+62:11399:x1868815120003328:12345-192.168.204.58@tcp:34:lhsmtool_posix.0 Request processed in 555us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241286.542502:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 125 00000100:00100000:0.0:1782241286.555378:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241286.555531:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120003584 00000100:00100000:2.0:1782241286.555541:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120003584 00000100:00100000:2.0:1782241286.555600:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 126 00000100:00100000:2.0:1782241286.555609:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+62:11399:x1868815120003584:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782241286.555632:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241286.555651:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19fbb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505299 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.555797:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19fc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.555813:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.555824:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241286.555836:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1782241286.555922:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.555929:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19fc2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.555953:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.555958:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241286.555962:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.555970:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19fc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.555981:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:2.0:1782241286.555984:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782241286.555988:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19fc2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.555994:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e19fc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.556032:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19fbb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505299 expref: 64 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.556041:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890e81fbc300) 00010000:00010000:2.0:1782241286.556043:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782241286.556047:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e19fbb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505299 expref: 64 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.556056:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fade00, rc 0) 00000100:00100000:2.0:1782241286.556113:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:11399:x1868815120003584:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 504us (742us total) trans 4294967400 rc 301/301 00000100:00100000:2.0:1782241286.556130:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 126 00000100:00100000:2.0:1782241286.561111:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241286.561269:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120003712 00000100:00100000:3.0:1782241286.561278:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120003712 00000100:00100000:3.0:1782241286.561335:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 127 00000100:00100000:3.0:1782241286.561360:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:11399:x1868815120003712:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782241286.561397:0:6512:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782241286.561516:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:11399:x1868815120003712:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 Request processed in 158us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241286.561524:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 127 00000100:00100000:0.0:1782241286.569253:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241286.569784:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120003968 00000100:00100000:3.0:1782241286.569793:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120003968 00000100:00100000:3.0:1782241286.569855:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 128 00000100:00100000:3.0:1782241286.569865:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:11399:x1868815120003968:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782241286.569885:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241286.569888:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782241286.569926:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e19f60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350527d expref: 63 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.569945:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:3.0:1782241286.569950:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782241286.569964:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19fd0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335052a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782241286.570552:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1782241286.570697:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19fd7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.570710:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.570721:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.570846:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19fd0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052a0 expref: 65 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.570862:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052a0 expref: 64 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.570870:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff890e528b3100) 00010000:00010000:3.0:1782241286.570873:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782241286.570876:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d000, rc 0) 00000100:00100000:3.0:1782241286.570997:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+64:11399:x1868815120003968:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 1132us (1755us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1782241286.571006:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 128 00000100:00100000:0.0:1782241286.579648:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241286.583990:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120004224 00000100:00100000:3.0:1782241286.584005:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120004224 00000100:00100000:3.0:1782241286.584088:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 129 00000100:00100000:3.0:1782241286.584099:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+64:11399:x1868815120004224:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782241286.584155:0:10147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241286.584182:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e19fd7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052a0 expref: 64 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584199:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff890e528b3100) 00010000:00010000:3.0:1782241286.584209:0:10147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782241286.584227:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19fe5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584239:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19fe5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584264:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19fe5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584332:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19fec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x8923e153 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584341:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19fec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8923e153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584348:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19fec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8923e153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584392:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19fe5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584400:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19fe5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584406:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19fe5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584412:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241286.584416:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19fe5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584423:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19fe5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584431:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:3.0:1782241286.584434:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241286.584437:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19fe5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584451:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e19fe5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584461:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19fec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8923e153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584467:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19fec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8923e153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584473:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19fec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8923e153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584479:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241286.584482:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19fec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8923e153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584489:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19fec lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8923e153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584498:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x8923e153 (ffff890e528b3000) 00010000:00010000:3.0:1782241286.584500:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241286.584503:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19fec lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8923e153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.584509:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e19fec lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8923e153 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241286.584584:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:11399:x1868815120004224:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 486us (4945us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782241286.584592:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 129 00000100:00100000:3.0:1782241286.587214:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241286.587360:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120004352 00000100:00100000:1.0:1782241286.587369:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120004352 00000100:00100000:1.0:1782241286.587430:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 130 00000100:00100000:1.0:1782241286.587440:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:11399:x1868815120004352:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782241286.587460:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241286.587480:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19ff3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335052a7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.587515:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19ffa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.587528:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19ffa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.587539:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19ffa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.587650:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e19ff3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052a7 expref: 65 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.587676:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19ffa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052a7 expref: 64 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.587685:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:1.0:1782241286.587688:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782241286.587691:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea200, rc 0) 00000100:00100000:1.0:1782241286.587751:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+64:11399:x1868815120004352:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 312us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241286.587790:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 130 00000100:00100000:0.0:1782241286.600253:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241286.600519:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120004608 00000100:00100000:3.0:1782241286.600530:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120004608 00000100:00100000:3.0:1782241286.600599:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 131 00000100:00100000:3.0:1782241286.600610:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+64:11399:x1868815120004608:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782241286.600713:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a001 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.600732:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a001 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.600745:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a001 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782241286.600960:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:3.0:1782241286.601016:0:6511:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002778c757 reply state 00000000193a19bc transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a001 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.601030:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a001 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.601039:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:3.0:1782241286.601042:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1782241286.601046:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782241286.601276:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:11399:x1868815120004608:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 667us (1031us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1782241286.601285:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 131 00000100:00100000:3.0:1782241286.610193:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241286.610300:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120004736 00000100:00100000:1.0:1782241286.610309:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120004736 00000100:00100000:1.0:1782241286.610379:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 132 00000100:00100000:1.0:1782241286.610390:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:11399:x1868815120004736:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782241286.610419:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241286.610442:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a008 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335052ae expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.610504:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a008 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052ae expref: 67 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.610519:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a008 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052ae expref: 67 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.610539:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:1.0:1782241286.610543:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782241286.610559:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ebc00, rc 0) 00000100:00100000:1.0:1782241286.610634:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+67:11399:x1868815120004736:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 245us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241286.610643:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 132 00000100:00100000:2.0:1782241286.619741:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241286.619923:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120004864 00000100:00100000:1.0:1782241286.619934:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120004864 00000100:00100000:1.0:1782241286.620012:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 45 00000100:00100000:1.0:1782241286.620023:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2398:x1868815120004864:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1782241286.620254:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2398:x1868815120004864:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 Request processed in 232us (525us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1782241286.620264:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 45 00000100:00080000:2.0:1782241286.620873:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782241286.623560:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241286.623708:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120005120 00000100:00100000:1.0:1782241286.623717:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120005120 00000100:00100000:1.0:1782241286.623803:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 30 00000100:00100000:1.0:1782241286.623813:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+67:11399:x1868815120005120:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782241286.624094:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+68:11399:x1868815120005120:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 280us (543us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1782241286.624103:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 30 00000100:00100000:0.0:1782241286.632376:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241286.632597:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120005376 00000100:00100000:2.0:1782241286.632608:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120005376 00000100:00100000:2.0:1782241286.632672:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 133 00000100:00100000:2.0:1782241286.632682:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+68:11399:x1868815120005376:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782241286.632834:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+68:11399:x1868815120005376:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 152us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241286.632842:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 133 00000100:00100000:2.0:1782241286.643390:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241286.643520:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120005504 00000100:00100000:3.0:1782241286.643530:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120005504 00000100:00100000:3.0:1782241286.643602:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 134 00000100:00100000:3.0:1782241286.643613:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+68:11399:x1868815120005504:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782241286.643634:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241286.643655:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a00f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335052b5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.643727:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a016 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.643742:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a016 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.643793:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a016 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241286.643841:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782241286.643861:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a016 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.643888:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a00f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052b5 expref: 70 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.643920:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a016 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052b5 expref: 69 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.643930:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:3.0:1782241286.643932:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782241286.643936:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d000, rc 0) 00000100:00100000:3.0:1782241286.643980:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+69:11399:x1868815120005504:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 371us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241286.643992:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 134 00000100:00100000:0.0:1782241286.646720:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241286.646879:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120005632 00000100:00100000:1.0:1782241286.646889:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120005632 00000100:00100000:1.0:1782241286.646959:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 46 00000100:00100000:1.0:1782241286.646969:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2398:x1868815120005632:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782241286.646985:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241286.647004:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a01d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335052bc expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782241286.647045:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3ad806, blocks: 0x0 00010000:00010000:1.0:1782241286.647064:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1782241286.647068:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241286.647077:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a01d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052bc expref: 10 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.647866:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a01d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052bc expref: 10 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.647880:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb800, rc 0) 00000100:00100000:1.0:1782241286.648003:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+10:2398:x1868815120005632:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 1034us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241286.648011:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 46 00000100:00100000:0.0:1782241286.658684:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241286.658799:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120005888 00000100:00100000:2.0:1782241286.658808:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120005888 00000100:00100000:2.0:1782241286.658867:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 135 00000100:00100000:2.0:1782241286.658877:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+69:11399:x1868815120005888:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782241286.658998:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+69:11399:x1868815120005888:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 122us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241286.659007:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 135 00000100:00100000:3.0:1782241286.664751:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241286.664884:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120006016 00000100:00100000:0.0:1782241286.664893:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120006016 00000100:00100000:0.0:1782241286.664962:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 47 00000100:00100000:0.0:1782241286.664974:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+10:11399:x1868815120006016:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782241286.664994:0:8747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241286.665013:0:8747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024249f44/0xc9959f2fb1e1a024 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335052c3 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.665043:0:8747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a01d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052bc expref: 11 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.665052:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241286.665055:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241286.665073:0:8747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024249f44/0xc9959f2fb1e1a024 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052c3 expref: 11 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.665122:0:8747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a01d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052bc expref: 11 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.665137:0:8747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a01d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052bc expref: 11 pid: 8423 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241286.665152:0:8747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:8747:1868815139998976:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241286.665268:0:8747:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e51155840 going to sleep for 11 seconds 00000100:00100000:0.0:1782241286.678502:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241286.678628:0:8747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:8747:1868815139998976:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241286.678663:0:8747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024249f44/0xc9959f2fb1e1a024 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052c3 expref: 11 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.678684:0:8747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1800, rc 0) 00000100:00100000:2.0:1782241286.678809:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:11399:x1868815120006016:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 13837us (14067us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241286.678819:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 47 00000100:00100000:3.0:1782241286.678947:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120006144 00000100:00100000:3.0:1782241286.678956:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120006144 00010000:00010000:3.0:1782241286.678988:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a01d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052bc expref: 11 pid: 8423 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241286.679025:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 71 00000100:00100000:3.0:1782241286.679034:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:2398:x1868815120006144:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241286.679048:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241286.679068:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a01d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052bc expref: 11 pid: 8423 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.679098:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a01d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052bc expref: 11 pid: 8423 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.679123:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a01d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052bc expref: 11 pid: 8423 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.679139:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241286.679143:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241286.679151:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024249f44/0xc9959f2fb1e1a024 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052c3 expref: 10 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.679162:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024249f44/0xc9959f2fb1e1a024 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052c3 expref: 10 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.679206:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000024249f44/0xc9959f2fb1e1a024 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052c3 expref: 10 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241286.679221:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f6ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6496:1868815139999104:192.168.204.58@tcp:105: 00000100:00100000:3.0:1782241286.679272:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e779636c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241286.683526:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f6ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6496:1868815139999104:192.168.204.58@tcp:105: 00010000:00010000:1.0:1782241286.683556:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241286.683614:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+10:2398:x1868815120006144:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 4580us (5122us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241286.683625:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 71 00000100:00100000:0.0:1782241286.686379:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241286.686518:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120006272 00000100:00100000:3.0:1782241286.686528:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120006272 00002000:00100000:3.0:1782241286.686576:0:8430:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff890d48135180 x1868815120006272/t0(0) o4->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:377/0 lens 504/0 e 0 to 0 dl 1782241297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782241286.686587:0:8430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d48135180 with x1868815120006272 ext(0->12) 00002000:00010000:3.0:1782241286.686593:0:8430:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff890d48135180 00000100:00100000:3.0:1782241286.686623:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 2 00000100:00100000:3.0:1782241286.686632:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+10:2398:x1868815120006272:12345-192.168.204.58@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1782241286.687540:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+12:2398:x1868815120006272:12345-192.168.204.58@tcp:4:lhsmtool_posix.0 Request processed in 905us (1166us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1782241286.687549:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 2 00002000:00100000:3.0:1782241286.687557:0:8430:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff890d48135180 x1868815120006272/t4294967309(0) o4->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:377/0 lens 504/448 e 0 to 0 dl 1782241297 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782241286.687565:0:8430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d48135180 with x1868815120006272 ext(0->12) 00002000:00010000:3.0:1782241286.687570:0:8430:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff890d48135180 00000100:00100000:0.0:1782241286.696339:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241286.696503:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120006400 00000100:00100000:1.0:1782241286.696513:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120006400 00000100:00100000:1.0:1782241286.696577:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 136 00000100:00100000:1.0:1782241286.696587:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+69:11399:x1868815120006400:12345-192.168.204.58@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1782241286.700217:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:2.0:1782241286.700243:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1782241286.700281:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1782241286.700311:0:6489:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff890e77963600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1782241286.700317:0:6489:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e7d77bd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff890e489906c0 00000020:00080000:2.0:1782241286.700320:0:6489:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e7d77bc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff890d47878000 00000004:00080000:2.0:1782241286.700347:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1782241286.700371:0:6489:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff890e437480c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1782241286.700374:0:6489:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e503af500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff890e43748f00 00000020:00080000:2.0:1782241286.700385:0:6489:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e503af700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff890e438d7200 00000020:00080000:2.0:1782241286.700396:0:6489:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1782241286.700400:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1782241286.702184:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1782241286.702256:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:1.0:1782241286.704055:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19d29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704109:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19d29 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704118:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19d29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704125:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241286.704131:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19d29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704140:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19d29 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704167:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff890e81fbc000) 00010000:00010000:1.0:1782241286.704171:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241286.704178:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19d29 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704185:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e19d29 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704219:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19dd1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704226:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19dd1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704232:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19dd1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704237:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241286.704247:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19dd1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704255:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19dd1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704267:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff890d4781b000) 00010000:00010000:1.0:1782241286.704270:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241286.704274:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19dd1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704280:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e19dd1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241286.704291:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f6cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139999360:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782241286.704297:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e4f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704306:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e4f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704312:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e4f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704317:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241286.704320:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e4f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704326:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e4f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704335:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890d4781b200) 00010000:00010000:1.0:1782241286.704338:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241286.704348:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e4f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704355:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e19e4f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241286.704363:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782241286.704370:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704395:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e72 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704402:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704408:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43face00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241286.704411:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241286.704417:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1782241286.704418:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e72 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241286.704428:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139999232:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782241286.704431:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890d4781b200) 00010000:00010000:1.0:1782241286.704436:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241286.704438:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e72 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704445:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e19e72 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241286.704456:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782241286.704463:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704480:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f44 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704486:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704502:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fadc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241286.704506:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704513:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f44 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704522:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:1.0:1782241286.704524:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241286.704527:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f44 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704533:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e19f44 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704546:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a001 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704553:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a001 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704558:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a001 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704563:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241286.704575:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a001 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704581:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a001 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704590:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:1.0:1782241286.704604:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782241286.704608:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a001 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704618:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a001 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241286.704648:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139999360 00000100:00100000:1.0:1782241286.704656:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139999360 00000100:00100000:1.0:1782241286.704705:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815139999232 00000100:00100000:1.0:1782241286.704709:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815139999232 00000100:00100000:1.0:1782241286.704739:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782241286.704748:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1868815139999360:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782241286.704791:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782241286.704801:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3640:x1868815139999232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782241286.704809:0:8423:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00080000:3.0:1782241286.704819:0:8746:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1782241286.704834:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a02b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782241286.704847:0:8746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a3ad805, atime: 0x6a3ad805, ctime: 0x6a3ad805, blocks: 0x8 00010000:00010000:3.0:1782241286.704856:0:8746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a032 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704857:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e19ddf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350521b expref: 11 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.704885:0:8746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1782241286.704885:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1782241286.704896:0:8746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241286.704909:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782241286.704915:0:8746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a032 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704917:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a02b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.704932:0:8746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a032 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.704942:0:8746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a032 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.704949:0:8746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a032 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.704957:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e19ddf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350521b expref: 11 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.704968:0:8746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241286.704974:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e19ddf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350521b expref: 11 pid: 8425 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241286.704988:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1868815139999488:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241286.705061:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48220c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241286.705128:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3640:x1868815139999232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 328us (671us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1782241286.705147:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782241286.705153:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+16:11399:x1868815120006400:12345-192.168.204.58@tcp:44:lhsmtool_posix.0 Request processed in 8565us (8831us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241286.705162:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 136 00000004:00080000:3.0:1782241286.705199:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890d47a98700/2, rc 0, transno 4294967305 00000100:00100000:3.0:1782241286.705208:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139999232:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782241286.705825:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241286.705833:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a032 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.705843:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241286.705847:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a032 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.705856:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a032 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.705888:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a032 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.705906:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a032 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.705926:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241286.705928:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241286.705930:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782241286.710433:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1782241286.710460:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1782241286.710489:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241286.710528:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1868815139999488:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241286.710555:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00010000:00010000:1.0:1782241286.710565:0:8423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a02b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241286.710624:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120006656 00000100:00100000:2.0:1782241286.710631:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120006656 00000100:00100000:2.0:1782241286.710688:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 50 00000100:00100000:2.0:1782241286.710697:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+12:2398:x1868815120006656:12345-192.168.204.58@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1782241286.710829:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120006528 00000100:00100000:3.0:1782241286.710834:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120006528 00010000:00010000:3.0:1782241286.710857:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e19ddf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350521b expref: 13 pid: 8425 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241286.710887:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 72 00000100:00100000:3.0:1782241286.710894:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e477c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+13:2399:x1868815120006528:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241286.710916:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241286.710922:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e19ddf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350521b expref: 13 pid: 8425 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.710937:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e19ddf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350521b expref: 13 pid: 8425 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.710961:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078f4abd3/0xc9959f2fb1e19ddf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350521b expref: 13 pid: 8425 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.710978:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782241286.710982:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782241286.710989:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a02b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.711019:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a02b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.711056:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241286.711127:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e477c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+12:2399:x1868815120006528:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 233us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241286.711136:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 72 00010000:00010000:2.0:1782241286.711343:0:8423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a02b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.711354:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a02b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.711377:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a02b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.711386:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a02b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.711405:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782241286.711577:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1868815139999360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6829us (7214us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1782241286.711584:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1782241286.711845:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241286.711852:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a02b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.711862:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241286.711867:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a02b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782241286.711871:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890e7f6cf100/2, rc 0, transno 4294967310 00010000:00010000:3.0:1782241286.711880:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a02b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241286.711906:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f6cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815139999360:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782241286.711909:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a02b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.711920:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eb55a3b/0xc9959f2fb1e1a02b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.711940:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241286.711949:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241286.711951:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782241286.717920:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1782241286.717934:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1782241286.718120:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2398:x1868815120006656:12345-192.168.204.58@tcp:16:lhsmtool_posix.0 Request processed in 7417us (7561us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241286.718133:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 50 00000100:00100000:0.0:1782241286.724470:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241286.724671:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120006912 00000100:00100000:1.0:1782241286.724685:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120006912 00000100:00100000:1.0:1782241286.724814:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 137 00000100:00100000:1.0:1782241286.724828:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+16:11399:x1868815120006912:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782241286.724915:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241286.724944:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a016 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052b5 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.724966:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:1.0:1782241286.724971:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241286.724998:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a039 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.725011:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a039 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.725020:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a039 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782241286.726063:0:6510:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009881f83f reply state 00000000398a5f24 transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a039 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.726149:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a039 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.726225:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:1.0:1782241286.726229:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782241286.726233:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782241286.726348:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+17:11399:x1868815120006912:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 1521us (1892us total) trans 4294967404 rc 0/0 00000100:00100000:1.0:1782241286.726357:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 137 00000100:00100000:0.0:1782241286.729123:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241286.729499:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120007040 00000100:00100000:2.0:1782241286.729509:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120007040 00000100:00100000:2.0:1782241286.729568:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 51 00000100:00100000:2.0:1782241286.729577:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2397:x1868815120007040:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1782241286.729793:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1782241286.729797:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1782241285 00002000:00010000:2.0:1782241286.729799:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1782241285 00002000:00010000:2.0:1782241286.729801:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1782241286 -> 1782241285 00002000:00010000:2.0:1782241286.729803:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1782241286.730981:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2397:x1868815120007040:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 Request processed in 1398us (1862us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1782241286.731011:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 51 00000100:00100000:0.0:1782241286.748687:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241286.748829:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120007296 00000100:00100000:3.0:1782241286.748840:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120007296 00000100:00100000:3.0:1782241286.748921:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 138 00000100:00100000:3.0:1782241286.748932:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+17:11399:x1868815120007296:12345-192.168.204.58@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782241286.749009:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a040 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.749025:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19ffa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052a7 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.749035:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a040 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.749072:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19ffa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052a7 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.749284:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19ffa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052a7 expref: 17 pid: 6510 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241286.749300:0:6512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f6cfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1868815139999616:192.168.204.58@tcp:104: 00000100:00100000:3.0:1782241286.749473:0:6512:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77963240 going to sleep for 11 seconds 00000100:00100000:2.0:1782241286.755133:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241286.755248:0:6512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f6cfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1868815139999616:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241286.755276:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a040 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241286.755457:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120007424 00000100:00100000:0.0:1782241286.755464:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120007424 00010000:00010000:0.0:1782241286.755502:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19ffa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052a7 expref: 18 pid: 6510 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241286.755543:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 73 00000100:00100000:0.0:1782241286.755553:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:2399:x1868815120007424:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241286.755567:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241286.755574:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19ffa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052a7 expref: 18 pid: 6510 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.755586:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19ffa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052a7 expref: 18 pid: 6510 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.755625:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e19ffa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052a7 expref: 18 pid: 6510 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.755641:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:0.0:1782241286.755646:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a040 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.755657:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.755665:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a040 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.755694:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241286.755752:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+17:2399:x1868815120007424:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 200us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241286.755802:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 73 00010000:00010000:3.0:1782241286.755921:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.755936:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.755977:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.755985:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a040 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.755993:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a040 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.755999:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241286.756004:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a040 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.756012:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a040 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.756023:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:3.0:1782241286.756026:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1782241286.756030:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a040 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.756037:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a040 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241286.756093:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+16:11399:x1868815120007296:12345-192.168.204.58@tcp:55:lhsmtool_posix.0 Request processed in 7162us (7420us total) trans 0 rc -22/-22 00000100:00100000:3.0:1782241286.756102:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 138 00000100:00100000:0.0:1782241286.759243:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241286.759359:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120007552 00000100:00100000:1.0:1782241286.759369:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120007552 00000100:00100000:1.0:1782241286.759433:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 52 00000100:00100000:1.0:1782241286.759457:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2399:x1868815120007552:12345-192.168.204.58@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782241286.759504:0:8746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1a047 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.759525:0:8746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024249f44/0xc9959f2fb1e1a024 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052c3 expref: 7 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.759532:0:8746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782241286.759536:0:8746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782241286.759540:0:8746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1a047 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.759574:0:8746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024249f44/0xc9959f2fb1e1a024 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052c3 expref: 7 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.759587:0:8746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024249f44/0xc9959f2fb1e1a024 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052c3 expref: 7 pid: 8747 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241286.759601:0:8746:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8746:1868815139999744:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241286.759680:0:8746:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48220cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241286.771613:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241286.771696:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120007680 00000100:00100000:3.0:1782241286.771705:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120007680 00010000:00010000:3.0:1782241286.771744:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024249f44/0xc9959f2fb1e1a024 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052c3 expref: 8 pid: 8747 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241286.771812:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 74 00000100:00100000:3.0:1782241286.771822:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2399:x1868815120007680:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241286.771837:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241286.771859:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024249f44/0xc9959f2fb1e1a024 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052c3 expref: 8 pid: 8747 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.771874:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024249f44/0xc9959f2fb1e1a024 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052c3 expref: 8 pid: 8747 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.771912:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782241286.771918:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782241286.771924:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1a047 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.771935:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1a047 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.771956:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241286.772019:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2399:x1868815120007680:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 198us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241286.772027:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 74 00010000:00010000:1.0:1782241286.772711:0:8746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024249f44/0xc9959f2fb1e1a024 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052c3 expref: 7 pid: 8747 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241286.772730:0:8746:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8746:1868815139999744:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241286.772753:0:8746:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1a047 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.772818:0:8746:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1a047 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.772826:0:8746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1a047 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.772846:0:8746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1a047 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.772854:0:8746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1a047 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.772863:0:8746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1a047 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.772869:0:8746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241286.772873:0:8746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1a047 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.772882:0:8746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1a047 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.772906:0:8746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1a047 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.772925:0:8746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000145b77a9/0xc9959f2fb1e1a047 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241286.772989:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815120007552:12345-192.168.204.58@tcp:1:lhsmtool_posix.0 Request processed in 13533us (13758us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241286.772998:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 52 00000100:00100000:2.0:1782241286.786060:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241286.786209:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120007936 00000100:00100000:1.0:1782241286.786219:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120007936 00000100:00100000:1.0:1782241286.786277:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 139 00000100:00100000:1.0:1782241286.786287:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+16:11399:x1868815120007936:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782241286.786376:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a04e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.786403:0:10147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350526f expref: 16 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.786414:0:10147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a04e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.786448:0:10147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350526f expref: 16 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.786462:0:10147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350526f expref: 16 pid: 11191 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241286.786484:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815139999872:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241286.786586:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48220cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1782241286.789505:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241286.794742:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815139999872:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241286.794808:0:10147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a04e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241286.796551:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241286.796658:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120008064 00000100:00100000:0.0:1782241286.796666:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120008064 00010000:00010000:0.0:1782241286.796706:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350526f expref: 17 pid: 11191 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241286.796746:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 75 00000100:00100000:0.0:1782241286.796793:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+17:2398:x1868815120008064:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241286.796808:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241286.796814:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350526f expref: 17 pid: 11191 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.796839:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350526f expref: 17 pid: 11191 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.796861:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e19f3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350526f expref: 17 pid: 11191 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.796878:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:0.0:1782241286.796884:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19f9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505292 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.796894:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a04e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.796913:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a04e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.796921:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a04e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241286.796943:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241286.796998:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+16:2398:x1868815120008064:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 243us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241286.797006:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 75 00010000:00010000:1.0:1782241286.797231:0:10147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a04e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.797240:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a04e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.797403:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a055 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.797416:0:10147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a008 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052ae expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.797424:0:10147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a055 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.797452:0:10147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a008 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052ae expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.797465:0:10147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a008 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052ae expref: 16 pid: 6510 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241286.797478:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140000000:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241286.797529:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241286.803588:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140000000:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241286.803618:0:10147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a055 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241286.811220:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241286.811530:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120008192 00000100:00100000:1.0:1782241286.811540:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120008192 00010000:00010000:1.0:1782241286.811582:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a008 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052ae expref: 17 pid: 6510 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241286.811625:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 76 00000100:00100000:1.0:1782241286.811635:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+17:2399:x1868815120008192:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241286.811654:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241286.811661:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a008 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052ae expref: 17 pid: 6510 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.811675:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a008 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052ae expref: 17 pid: 6510 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.811700:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a008 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052ae expref: 17 pid: 6510 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.811717:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:1.0:1782241286.811723:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a055 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.811733:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a055 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.811741:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a055 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.811945:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241286.812086:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+16:2399:x1868815120008192:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 443us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241286.812095:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 76 00010000:00010000:2.0:1782241286.812158:0:10147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a055 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.812168:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a055 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782241286.812276:0:10147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1782241286.812392:0:10147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:2.0:1782241286.812426:0:10147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1782241286.812514:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10147:1868815140000128:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782241286.812564:0:10147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241286.812627:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48220cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241286.812677:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140000128 00000100:00100000:0.0:1782241286.812683:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140000128 00000100:00100000:0.0:1782241286.812722:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782241286.812730:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10147:x1868815140000128:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782241286.812867:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10147:x1868815140000128:12345-0@lo:1000:mdt00_003.0 Request processed in 137us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241286.812874:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1782241286.812962:0:10147:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1782241286.812967:0:10147:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1782241286.812991:0:10147:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff890e7f6cf100, transno 4294967310 00000100:00100000:2.0:1782241286.813011:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10147:1868815140000128:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1782241286.813112:0:10147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:2.0:1782241286.813151:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10147:1868815140000256:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782241286.813177:0:10147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241286.813197:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47934240 going to sleep for 11 seconds 00000100:00100000:0.0:1782241286.813305:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140000256 00000100:00100000:0.0:1782241286.813309:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140000256 00000100:00100000:0.0:1782241286.813340:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1782241286.813348:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10147:x1868815140000256:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782241286.813446:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10147:x1868815140000256:12345-0@lo:1000:mdt00_003.0 Request processed in 98us (267us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1782241286.813453:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1782241286.813660:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10147:1868815140000256:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1782241286.813699:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a055 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.813708:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a055 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.813716:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a055 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.813722:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241286.813727:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a055 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.813735:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a055 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.813749:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:2.0:1782241286.813752:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782241286.813789:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a055 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.813797:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a055 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.813820:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.813828:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f98 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.813834:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f98 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.813849:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241286.813852:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f98 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.813859:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f98 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.813868:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:2.0:1782241286.813871:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782241286.813878:0:10147:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19f9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505292 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.813889:0:10147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19f9f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505292 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.813911:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19f9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505292 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.813937:0:10147:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19f9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505292 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241286.813948:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140000384:192.168.204.58@tcp:105: 00000100:00100000:2.0:1782241286.813995:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77983b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241286.826700:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241286.826855:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140000384:192.168.204.58@tcp:105: 00010000:00010000:2.0:1782241286.826884:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f98 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.826920:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e19f98 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.826954:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a05c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.826969:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a05c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.826981:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a05c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.826991:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a05c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.826998:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a05c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.827004:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a05c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.827010:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241286.827014:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a05c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.827023:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a05c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.827034:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:2.0:1782241286.827038:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241286.827041:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a05c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.827054:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a05c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.827064:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a04e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.827070:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a04e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.827088:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a04e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.827093:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241286.827097:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a04e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.827102:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a04e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.827111:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:2.0:1782241286.827114:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782241286.827117:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a04e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241286.827122:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a04e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241286.827279:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:11399:x1868815120007936:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 40992us (41227us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1782241286.827290:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 139 00000020:00080000:2.0:1782241286.827303:0:10147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1782241286.827734:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120008320 00000100:00100000:1.0:1782241286.827743:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120008320 00000100:00100000:1.0:1782241286.827823:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 31 00000100:00100000:1.0:1782241286.827832:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:11398:x1868815120008320:12345-192.168.204.58@tcp:49:lfs.0 00000100:00100000:1.0:1782241286.827951:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:11398:x1868815120008320:12345-192.168.204.58@tcp:49:lfs.0 Request processed in 119us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241286.827958:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 31 00000040:00080000:3.0:1782241286.828413:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782241286.828418:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782241286.828957:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1782241286.828966:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782241286.844070:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241286.844187:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241286.844299:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120008576 00000100:00100000:1.0:1782241286.844310:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120008576 00000100:00100000:1.0:1782241286.844372:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 32 00000100:00100000:1.0:1782241286.844382:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47a4a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:11399:x1868815120008576:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1782241286.844675:0:6514:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1782241286.844707:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:1.0:1782241286.844739:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a063 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.844793:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a063 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.844805:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a063 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.844814:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a063 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.844835:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a063 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.844841:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a063 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.844860:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241286.844907:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241286.844912:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a063 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.844919:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ebc00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241286.844923:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a063 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.844930:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a063 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.844943:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:1.0:1782241286.844946:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782241286.844950:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a063 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.844956:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a063 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.844965:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241286.844967:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241286.844969:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241286.845031:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47a4a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:11399:x1868815120008576:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 649us (969us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1782241286.845048:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 32 00000020:00080000:1.0:1782241286.845054:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782241286.847921:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120008832 00000100:00100000:2.0:1782241286.847935:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120008832 00000100:00100000:2.0:1782241286.848047:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 140 00000100:00100000:2.0:1782241286.848059:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:11398:x1868815120008832:12345-192.168.204.58@tcp:58:lfs.0 00000040:00080000:2.0:1782241286.848238:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1782241286.848333:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:11398:x1868815120008832:12345-192.168.204.58@tcp:58:lfs.0 Request processed in 276us (4144us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241286.848341:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 140 00000100:00100000:0.0:1782241286.916121:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241286.916267:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120008960 00000100:00100000:3.0:1782241286.916278:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120008960 00000100:00100000:3.0:1782241286.916344:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 141 00000100:00100000:3.0:1782241286.916355:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:11401:x1868815120008960:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241286.916380:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241286.916403:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a06a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335052ca expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.916476:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a071 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.916492:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a071 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.916503:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a071 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.916518:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a078 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.916525:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a078 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.916531:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a078 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.916630:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1a07f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.916641:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e19f8a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350528b expref: 22 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.916648:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1a07f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.916679:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e19f8a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350528b expref: 22 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.916692:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e19f8a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350528b expref: 22 pid: 10147 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241286.916706:0:6512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f6cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1868815140000512:192.168.204.58@tcp:104: 00000100:00100000:3.0:1782241286.916857:0:6512:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77963240 going to sleep for 11 seconds 00000100:00100000:3.0:1782241286.918063:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140000640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241286.918113:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241286.918389:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241286.918397:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7785bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140000768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241286.918423:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241286.922340:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140000768 00000100:00100000:1.0:1782241286.922356:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140000768 00000100:00100000:1.0:1782241286.922419:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1782241286.922443:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140000768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782241286.922470:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1782241286.922485:0:6512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f6cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1868815140000512:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241286.922512:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1a07f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241286.922529:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140000768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (4104us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241286.922536:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1782241286.922551:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241286.922578:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7785bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140000768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241286.922611:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120009216 00000100:00100000:1.0:1782241286.922615:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120009216 00000100:00100000:1.0:1782241286.922651:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 33 00000100:00100000:1.0:1782241286.922658:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+23:6166:x1868815120009216:12345-192.168.204.58@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1782241286.922919:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+24:6166:x1868815120009216:12345-192.168.204.58@tcp:35:ldlm_bl.0 Request processed in 260us (367us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1782241286.922926:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 33 00000100:00100000:0.0:1782241286.927986:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140000640 00000100:00100000:0.0:1782241286.928003:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140000640 00000100:00100000:0.0:1782241286.928074:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782241286.928083:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140000640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241286.928122:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782241286.928320:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140000640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 237us (10206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241286.928328:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1782241286.935221:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140000640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241286.935611:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241286.935992:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120009344 00000100:00100000:3.0:1782241286.935998:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120009344 00010000:00010000:3.0:1782241286.936036:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e19f8a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350528b expref: 24 pid: 10147 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241286.936079:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 77 00000100:00100000:3.0:1782241286.936088:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+24:2398:x1868815120009344:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241286.936102:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241286.936108:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e19f8a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350528b expref: 24 pid: 10147 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.936120:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e19f8a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350528b expref: 24 pid: 10147 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.936202:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e19f8a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350528b expref: 24 pid: 10147 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.936218:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:3.0:1782241286.936223:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1a07f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.936232:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1a07f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.936241:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1a07f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241286.936330:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241286.936400:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+23:2398:x1868815120009344:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 313us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241286.936408:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 77 00010000:00010000:1.0:1782241286.942243:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1a07f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.942261:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1a07f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241286.942320:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1782241286.942325:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241286.942366:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1a07f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.942381:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1a07f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.942391:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a071 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.942398:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a071 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.942405:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a071 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.942411:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241286.942415:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a071 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.942423:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a071 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.943330:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:1.0:1782241286.943334:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241286.943340:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a071 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.943348:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a071 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.943367:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a078 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.943374:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a078 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.943390:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a078 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.943396:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241286.943399:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a078 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.943406:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a078 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.943414:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff890e528b3000) 00010000:00010000:1.0:1782241286.943417:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241286.943421:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a078 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.944211:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a078 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.944270:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a06a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052ca expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.944286:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1a07f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052ca expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241286.944294:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:1.0:1782241286.944296:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241286.944299:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c600, rc 0) 00000100:00100000:1.0:1782241286.944397:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:11401:x1868815120008960:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 28040us (28282us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241286.944416:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 141 00010000:00010000:2.0:1782241287.812978:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782241287.876945:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782241287.876967:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782241287.876994:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1782241287.877003:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782241287.877142:0:13782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f6cce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1868815140000896:192.168.204.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782241287.877479:0:13782:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4b25f540 going to sleep for 11 seconds 00000100:00100000:2.0:1782241287.887964:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241287.888029:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120009472 00000100:00100000:0.0:1782241287.888039:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120009472 00000100:00100000:0.0:1782241287.888103:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 142 00000100:00100000:0.0:1782241287.888112:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+23:11413:x1868815120009472:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 00000100:00100000:3.0:1782241287.888119:0:13782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f6cce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1868815140000896:192.168.204.58@tcp:107:hsm_cdtr.0 00000004:00000080:0.0:1782241287.888147:0:10147:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782241287.888261:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:11413:x1868815120009472:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 Request processed in 149us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241287.888298:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 142 00000100:00100000:3.0:1782241287.892162:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241287.892252:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120009728 00000100:00100000:2.0:1782241287.892262:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120009728 00000100:00100000:2.0:1782241287.892333:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 143 00000100:00100000:2.0:1782241287.892343:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:11413:x1868815120009728:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782241287.892366:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241287.892388:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e1a086 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335052d1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241287.892492:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a08d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241287.892507:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a08d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241287.892518:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a08d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241287.892529:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1782241287.892639:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e1a086 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052d1 expref: 25 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241287.892654:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a08d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052d1 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241287.892663:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:2.0:1782241287.892666:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241287.892669:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fade00, rc 0) 00000100:00100000:2.0:1782241287.892718:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+24:11413:x1868815120009728:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 376us (566us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1782241287.892725:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 143 00000100:00100000:3.0:1782241287.902540:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241287.903047:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120009984 00000100:00100000:1.0:1782241287.903058:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120009984 00000100:00100000:1.0:1782241287.903155:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 144 00000100:00100000:1.0:1782241287.903166:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+24:11413:x1868815120009984:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782241287.903246:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a09b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241287.903274:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a09b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241287.903288:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a09b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241287.903459:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a09b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241287.903468:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a09b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241287.903475:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a09b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241287.903481:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241287.903486:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a09b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241287.903494:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a09b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241287.903507:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:1.0:1782241287.903514:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782241287.903519:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a09b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241287.903525:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a09b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241287.903647:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+25:11413:x1868815120009984:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 482us (1116us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1782241287.903656:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 144 00000040:00080000:3.0:1782241287.903906:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782241287.903912:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782241287.904387:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1782241287.904396:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782241287.908214:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241287.909176:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120010240 00000100:00100000:3.0:1782241287.909188:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120010240 00000100:00100000:3.0:1782241287.909249:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 34 00000100:00100000:3.0:1782241287.909259:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+25:11413:x1868815120010240:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782241287.909503:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+26:11413:x1868815120010240:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 245us (1299us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1782241287.909512:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 34 00000100:00100000:0.0:1782241287.920903:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241287.921793:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120010368 00000100:00100000:2.0:1782241287.921806:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120010368 00000100:00100000:2.0:1782241287.921895:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:2.0:1782241287.921907:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+26:2397:x1868815120010368:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241287.921923:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241287.921952:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a08d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052d1 expref: 26 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241287.922403:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:2.0:1782241287.922409:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241287.924856:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+25:2397:x1868815120010368:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 2937us (3949us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241287.924871:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 11 00000040:00080000:1.0:1782241288.016127:0:14267:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782241288.016136:0:14267:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782241288.016179:0:14267:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1782241288.016187:0:14267:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782241288.260430:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241288.260666:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120010624 00000100:00100000:2.0:1782241288.260676:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120010624 00000100:00080000:1.0:1782241288.260852:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241288.260919:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 145 00000100:00100000:2.0:1782241288.260932:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7785bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+25:11426:x1868815120010624:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241288.260959:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241288.260983:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a0a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335052d8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241288.261099:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e1a0a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241288.261116:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e1a0a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241288.261128:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e1a0a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241288.261141:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1782241288.261334:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a0a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052d8 expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241288.261354:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e1a0a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052d8 expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241288.261362:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:2.0:1782241288.261365:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782241288.261369:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fac600, rc 0) 00000100:00100000:2.0:1782241288.261477:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7785bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:11426:x1868815120010624:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 548us (1061us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1782241288.261485:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 145 00000100:00100000:0.0:1782241288.272295:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241288.272475:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120010752 00000100:00100000:2.0:1782241288.272499:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120010752 00000100:00100000:2.0:1782241288.272558:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 146 00000100:00100000:2.0:1782241288.272568:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:11426:x1868815120010752:12345-192.168.204.58@tcp:54:lfs.0 00010000:00010000:2.0:1782241288.272636:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a0b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241288.272654:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241288.272665:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241288.272704:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241288.272710:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a0b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241288.272718:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241288.272723:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fade00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241288.272727:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241288.272733:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a0b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241288.272745:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:2.0:1782241288.272748:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782241288.272752:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a0b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241288.272812:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1a0b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241288.272902:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:11426:x1868815120010752:12345-192.168.204.58@tcp:54:lfs.0 Request processed in 335us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241288.272910:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 146 00000100:00100000:0.0:1782241288.424624:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241288.424781:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120010880 00000100:00100000:2.0:1782241288.424791:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120010880 00000100:00100000:2.0:1782241288.424882:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 53 00000100:00100000:2.0:1782241288.424895:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2398:x1868815120010880:12345-192.168.204.58@tcp:101:cat.0 00010000:00010000:2.0:1782241288.424915:0:8747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241288.424945:0:8747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1a0be lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335052df expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782241288.424974:0:8747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a3ad805, atime: 0x6a3ad805, ctime: 0x6a3ad805, blocks: 0x8 00010000:00010000:2.0:1782241288.424993:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1782241288.424997:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241288.425007:0:8747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1a0be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052df expref: 7 pid: 8747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241288.425025:0:8747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1a0be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052df expref: 7 pid: 8747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241288.425037:0:8747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fade00, rc 0) 00000100:00100000:2.0:1782241288.425116:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2398:x1868815120010880:12345-192.168.204.58@tcp:101:cat.0 Request processed in 224us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241288.425140:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 53 00000100:00080000:1.0:1782241288.425531:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782241288.431624:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241288.431747:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120011008 00000100:00100000:1.0:1782241288.431783:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120011008 00002000:00100000:1.0:1782241288.431836:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff890e7f6cc380 x1868815120011008/t0(0) o3->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:379/0 lens 488/0 e 0 to 0 dl 1782241299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782241288.431847:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890e7f6cc380 with x1868815120011008 ext(0->4095) 00002000:00010000:1.0:1782241288.431855:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff890e7f6cc380 00000100:00100000:1.0:1782241288.431901:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:1.0:1782241288.431910:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2399:x1868815120011008:12345-192.168.204.58@tcp:3:cat.0 00000100:00100000:1.0:1782241288.432213:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2399:x1868815120011008:12345-192.168.204.58@tcp:3:cat.0 Request processed in 302us (598us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1782241288.432221:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 3 00002000:00100000:1.0:1782241288.432228:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff890e7f6cc380 x1868815120011008/t0(0) o3->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:379/0 lens 488/4536 e 0 to 0 dl 1782241299 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782241288.432252:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890e7f6cc380 with x1868815120011008 ext(0->4095) 00002000:00010000:1.0:1782241288.432255:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff890e7f6cc380 00000100:00100000:0.0:1782241288.456646:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782241288.456671:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f6cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140001024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782241288.456743:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241288.458356:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140001024 00000100:00100000:3.0:1782241288.458370:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140001024 00000100:00100000:3.0:1782241288.458458:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782241288.458487:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140001024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782241288.458522:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241288.458600:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f643800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140001024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241288.458608:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782241288.458654:0:3640:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1782241288.458660:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:3.0:1782241288.458682:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff890e7f684e00, transno 4294967302 00000004:00080000:3.0:1782241288.458690:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1782241288.458702:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff890d47a98700, transno 4294967305 00000100:00100000:3.0:1782241288.458714:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f6cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140001024:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782241288.458851:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241288.459535:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782241288.459551:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140001152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782241288.459598:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241288.459845:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140001152 00000100:00100000:1.0:1782241288.459852:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140001152 00000100:00100000:1.0:1782241288.459915:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1782241288.459924:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140001152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782241288.459945:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241288.459985:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140001152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241288.459991:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1782241288.460153:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241288.460184:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140001152:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1782241288.837176:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241289.628283:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241289.628384:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241289.628415:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241289.628477:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120011520 00000100:00100000:2.0:1782241289.628505:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120011520 00000100:00100000:2.0:1782241289.628580:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 115 00000100:00100000:2.0:1782241289.628593:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815120011520:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241289.628689:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815120011520:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 99us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241289.628705:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 115 00000100:00080000:2.0:1782241289.628732:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241289.632168:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241289.632209:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241289.634733:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120011264 00000100:00100000:0.0:1782241289.634763:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120011264 00000100:00100000:2.0:1782241289.634905:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120011776 00000100:00100000:2.0:1782241289.634911:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120011776 00000100:00100000:2.0:1782241289.634989:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 285 00000100:00100000:2.0:1782241289.635001:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:2396:x1868815120011264:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241289.635123:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:2396:x1868815120011264:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 124us (6853us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241289.635131:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 285 00000100:00100000:2.0:1782241289.635152:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 286 00000100:00100000:2.0:1782241289.635159:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815120011776:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241289.635199:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815120011776:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 39us (6782us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241289.635207:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 286 00000100:00080000:2.0:1782241289.635425:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782241289.637356:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241289.637502:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120011392 00000100:00100000:0.0:1782241289.637513:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120011392 00000100:00100000:0.0:1782241289.637587:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 287 00000100:00100000:0.0:1782241289.637600:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815120011392:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241289.637679:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815120011392:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 81us (5468us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241289.637688:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 287 00000100:00100000:3.0:1782241289.639437:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241289.639523:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120011136 00000100:00100000:3.0:1782241289.639534:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120011136 00000100:00100000:0.0:1782241289.639546:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120011904 00000100:00100000:0.0:1782241289.639553:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120011904 00000100:00100000:3.0:1782241289.639604:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 382 00000100:00100000:0.0:1782241289.639609:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 288 00000100:00100000:3.0:1782241289.639619:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815120011136:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241289.639622:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815120011904:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241289.639693:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815120011904:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 75us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241289.639702:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 288 00000100:00100000:2.0:1782241289.644417:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120011648 00000100:00100000:2.0:1782241289.644439:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120011648 00000100:00100000:2.0:1782241289.644690:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 116 00000100:00100000:2.0:1782241289.644713:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2396:x1868815120011648:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241289.644988:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815120011136:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 5355us (12817us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241289.645001:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 382 00000100:00080000:3.0:1782241289.645887:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782241289.648227:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2396:x1868815120011648:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 3502us (10866us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241289.648247:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 116 00010000:00010000:1.0:1782241289.864829:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782241290.377116:0:13786:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782241290.509138:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f6ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140001280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241290.509325:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241290.513835:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140001280 00000100:00100000:2.0:1782241290.513859:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140001280 00000100:00100000:2.0:1782241290.513958:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1782241290.513972:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140001280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782241290.514043:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1782241290.514198:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140001280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 228us (4948us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241290.514207:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1782241290.514311:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f6ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140001280:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782241290.895631:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782241291.019896:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782241291.019910:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782241291.019932:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1782241291.019939:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782241291.525048:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140001408:0@lo:400:kworker.0 00000100:00100000:2.0:1782241291.525104:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140001792:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.525190:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241291.525210:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1782241291.525889:0:9979:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354784130079ns, next at 355784126290ns, rc = 0 00000100:00100000:3.0:1782241291.526020:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f59a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140001920:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.526073:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241291.526159:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140002432:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.526202:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241291.526224:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140002944:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.526249:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241291.526304:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140001408 00000100:00100000:3.0:1782241291.526314:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140001408 00000100:00100000:3.0:1782241291.526372:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1782241291.526383:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e469d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815140001408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.526465:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e469d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815140001408:12345-0@lo:400:kworker.0 Request processed in 83us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241291.526475:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1782241291.526543:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140001408:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.526599:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140001664:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.526627:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241291.528562:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140002176:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.528640:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241291.528875:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140002688:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.528904:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241291.528959:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1782241291.528969:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815140001536:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.529005:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241291.529026:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140002048:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.529058:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241291.529079:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815140002560:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.529106:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241291.529125:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140003072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241291.529160:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241291.529227:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140003072 00000100:00100000:3.0:1782241291.529237:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140003072 00000100:00100000:3.0:1782241291.529320:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1782241291.529334:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1868815140003072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782241291.529378:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782241291.529438:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1868815140003072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241291.532875:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1782241291.532948:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782241291.533053:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140003072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241291.533128:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140001792 00000100:00100000:3.0:1782241291.533136:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140001792 00000100:00100000:3.0:1782241291.533185:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140002176 00000100:00100000:3.0:1782241291.533188:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140002176 00000100:00100000:3.0:1782241291.533214:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140002688 00000100:00100000:3.0:1782241291.533217:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140002688 00000100:00100000:3.0:1782241291.533233:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140001536 00000100:00100000:3.0:1782241291.533236:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140001536 00000100:00100000:3.0:1782241291.533248:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140002048 00000100:00100000:3.0:1782241291.533280:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140002048 00000100:00100000:3.0:1782241291.533299:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140002560 00000100:00100000:3.0:1782241291.533302:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140002560 00000100:00100000:3.0:1782241291.533324:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1782241291.533333:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140001792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.533443:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140001792:12345-0@lo:400:kworker.0 Request processed in 112us (8251us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241291.535166:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1782241291.535218:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1782241291.535236:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e51ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140002176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.535360:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e51ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140002176:12345-0@lo:400:kworker.0 Request processed in 132us (6720us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241291.535368:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1782241291.535384:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1782241291.535392:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815140002688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.535425:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815140002688:12345-0@lo:400:kworker.0 Request processed in 34us (6520us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241291.535432:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1782241291.535456:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1782241291.535465:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815140001536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.535498:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815140001536:12345-0@lo:400:kworker.0 Request processed in 34us (6498us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241291.535504:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1782241291.535515:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1782241291.535522:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815140002048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.535549:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815140002048:12345-0@lo:400:kworker.0 Request processed in 28us (6491us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241291.535570:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1782241291.535583:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1782241291.535590:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d476ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815140002560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.535624:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d476ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815140002560:12345-0@lo:400:kworker.0 Request processed in 34us (6517us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241291.535630:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:3.0:1782241291.535677:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782241291.535684:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782241291.535735:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815140001536:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.535751:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140002048:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.535788:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815140002560:0@lo:400:kworker.0 00010000:00080000:3.0:1782241291.535822:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7f599f80 x1868815140002176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241291.535835:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140002176:0@lo:400:kworker.0 00010000:00080000:3.0:1782241291.535847:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47874000 x1868815140002688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241291.535855:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140002688:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.535924:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140001792:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.535940:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140002304:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.535985:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241291.536021:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140002816:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.536044:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241291.536230:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140002432 00000100:00100000:3.0:1782241291.536238:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140002432 00000100:00100000:3.0:1782241291.536286:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140002944 00000100:00100000:3.0:1782241291.536291:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140002944 00000100:00100000:3.0:1782241291.536305:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140002304 00000100:00100000:3.0:1782241291.536307:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140002304 00000100:00100000:3.0:1782241291.536317:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140002816 00000100:00100000:3.0:1782241291.536320:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140002816 00000100:00100000:3.0:1782241291.536335:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1782241291.536341:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140002432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.536385:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140002432:12345-0@lo:400:kworker.0 Request processed in 44us (10181us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241291.536393:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1782241291.536407:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782241291.536413:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815140002944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.536440:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815140002944:12345-0@lo:400:kworker.0 Request processed in 28us (10191us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241291.536446:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782241291.536456:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1782241291.536462:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140002304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.536490:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140002304:12345-0@lo:400:kworker.0 Request processed in 29us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241291.536496:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1782241291.536506:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1782241291.536512:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140002816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.536536:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140002816:12345-0@lo:400:kworker.0 Request processed in 24us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241291.536553:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1782241291.536569:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782241291.536572:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241291.536597:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140002432:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.536611:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140002944:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.536641:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140002304:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.536651:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140002816:0@lo:400:kworker.0 00000100:00100000:0.0:1782241291.537207:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140001920 00000100:00100000:0.0:1782241291.537217:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140001920 00000100:00100000:0.0:1782241291.537427:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140001664 00000100:00100000:0.0:1782241291.537431:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140001664 00000100:00100000:0.0:1782241291.537515:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1782241291.537525:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140001920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241291.537632:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140001920:12345-0@lo:400:kworker.0 Request processed in 109us (11558us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241291.537639:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1782241291.538007:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1782241291.538017:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140001664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241291.538065:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140001664:12345-0@lo:400:kworker.0 Request processed in 51us (11437us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241291.538072:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1782241291.538204:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f59a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140001920:0@lo:400:kworker.0 00000100:00100000:3.0:1782241291.538249:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140001664:0@lo:400:kworker.0 00010000:00010000:2.0:1782241291.909002:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241292.037198:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140003200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241292.037276:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241292.037466:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241292.037486:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140003328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241292.037520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241292.037579:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140003328 00000100:00100000:0.0:1782241292.037586:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140003328 00000100:00100000:0.0:1782241292.037648:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1782241292.037658:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140003328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241292.037683:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782241292.037739:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140003328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241292.037746:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1782241292.038088:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140003328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241292.038730:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140003200 00000100:00100000:1.0:1782241292.038737:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140003200 00000100:00100000:1.0:1782241292.038806:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1782241292.038814:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140003200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241292.038843:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241292.038903:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140003200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241292.038910:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1782241292.039847:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140003200:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1782241292.557010:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1782241292.557033:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000004:00080000:2.0:1782241292.557745:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:2.0:1782241292.557818:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1782241292.557844:0:6489:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff890d47ac1240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1782241292.557849:0:6489:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e42e0d200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff890e4b13b000 00000020:00080000:2.0:1782241292.557853:0:6489:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e529bed00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff890e8152b400 00000020:00080000:2.0:1782241292.557868:0:6489:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:2.0:1782241292.557889:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a039 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241292.557901:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a039 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241292.557909:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a039 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241292.557915:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241292.557920:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a039 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241292.557927:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a039 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241292.557954:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff890e81fbce00) 00010000:00010000:2.0:1782241292.557957:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241292.557968:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a039 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241292.557974:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a039 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782241292.558211:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1782241292.558290:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1782241292.558414:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241292.558434:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140003456:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1782241292.558504:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241292.558566:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140003456 00000100:00100000:3.0:1782241292.558572:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140003456 00000100:00100000:3.0:1782241292.558616:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782241292.558626:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140003456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1782241292.558744:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1782241292.558747:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1782241285 -> 1782241285 00002000:00010000:3.0:1782241292.558750:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1782241285 -> 1782241285 00002000:00010000:3.0:1782241292.558752:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1782241285 -> 1782241285 00002000:00010000:3.0:1782241292.558776:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1782241292.558833:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815140003456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 207us (328us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1782241292.558840:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782241292.558884:0:3637:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1782241292.558890:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1782241292.558914:0:3637:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff890e47ae8a80 x1868815140003456/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1782241308 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1782241292.558924:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890e47ae8a80/2, rc 0, transno 4294967313 00000100:00100000:3.0:1782241292.558929:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140003456:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1782241292.932912:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241293.378221:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241293.379221:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120012032 00000100:00100000:2.0:1782241293.379238:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120012032 00000100:00100000:2.0:1782241293.379339:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 147 00000100:00100000:2.0:1782241293.379350:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+13:11087:x1868815120012032:12345-192.168.204.58@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1782241293.379474:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+13:11087:x1868815120012032:12345-192.168.204.58@tcp:60:lhsmtool_posix.0 Request processed in 125us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241293.379482:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 147 00000100:00080000:3.0:1782241293.380209:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241293.391346:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241293.391570:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120012160 00000100:00100000:2.0:1782241293.391583:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120012160 00000100:00100000:2.0:1782241293.391676:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 148 00000100:00100000:2.0:1782241293.391691:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:11087:x1868815120012160:12345-192.168.204.58@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1782241293.391889:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:11087:x1868815120012160:12345-192.168.204.58@tcp:60:lhsmtool_posix.0 Request processed in 202us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241293.391898:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 148 00000100:00080000:3.0:1782241293.391980:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782241293.400465:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241293.400568:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120012416 00000100:00100000:3.0:1782241293.400584:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120012416 00000100:00100000:1.0:1782241293.401387:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 35 00000100:00100000:1.0:1782241293.401406:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+13:11087:x1868815120012416:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782241293.403112:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:11087:x1868815120012416:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 1701us (2651us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1782241293.403128:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 35 00000100:00100000:0.0:1782241293.573289:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140003584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241293.573401:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241293.573489:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140003584 00000100:00100000:2.0:1782241293.573501:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140003584 00000100:00100000:2.0:1782241293.573578:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1782241293.573592:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140003584:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241293.573596:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140003712:0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782241293.573632:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241293.573638:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241293.573718:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1782241293.573729:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1782241293.573920:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140003712 00000100:00100000:1.0:1782241293.573924:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140003712 00000100:00100000:1.0:1782241293.574070:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1782241293.574079:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140003712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782241293.574093:0:14428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241293.574132:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140003712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241293.574140:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1782241293.574213:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140003712:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782241293.574259:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241293.576038:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140003584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2438us (2625us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241293.576056:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1782241293.577453:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140003584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241293.598071:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241293.598427:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120012544 00000100:00100000:0.0:1782241293.598443:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120012544 00000100:00080000:1.0:1782241293.598601:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241293.598742:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 149 00000100:00100000:0.0:1782241293.598807:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:11886:x1868815120012544:12345-192.168.204.58@tcp:101:lsof.0 00010000:00010000:0.0:1782241293.598837:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241293.598866:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e1a0c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335052e6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241293.598959:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a0cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241293.598977:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a0cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241293.598994:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a0cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241293.599074:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782241293.599078:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241293.599124:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a0cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241293.599152:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e1a0c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052e6 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241293.599206:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a0cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052e6 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241293.599217:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b500) 00010000:00010000:0.0:1782241293.599221:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782241293.599225:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1200, rc 0) 00000100:00100000:0.0:1782241293.599438:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:11886:x1868815120012544:12345-192.168.204.58@tcp:101:lsof.0 Request processed in 685us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241293.599447:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 149 00010000:00010000:1.0:1782241293.957399:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241294.747966:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241294.748038:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241294.748080:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241294.748231:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120012928 00000100:00100000:1.0:1782241294.748246:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120012928 00000100:00100000:2.0:1782241294.748275:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120013184 00000100:00100000:2.0:1782241294.748303:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120013184 00000100:00100000:1.0:1782241294.748344:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 295 00000100:00100000:1.0:1782241294.748360:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815120012928:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241294.748368:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 121 00000100:00100000:2.0:1782241294.748379:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2396:x1868815120013184:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241294.748479:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2396:x1868815120013184:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 101us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241294.748489:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 121 00000100:00080000:2.0:1782241294.748553:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782241294.748712:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120012672 00000100:00100000:3.0:1782241294.748718:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120012672 00000100:00100000:3.0:1782241294.748806:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 384 00000100:00100000:3.0:1782241294.752915:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b8a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815120012672:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241294.753808:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815120012928:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 5444us (5761us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241294.753864:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 295 00000100:00100000:0.0:1782241294.756591:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241294.757397:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241294.758251:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b8a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815120012672:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 9428us (10292us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241294.758270:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 384 00000100:00100000:0.0:1782241294.761177:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241294.761218:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241294.761265:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120013056 00000100:00100000:3.0:1782241294.761278:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120013056 00000100:00100000:3.0:1782241294.761359:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 122 00000100:00100000:3.0:1782241294.761372:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815120013056:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241294.761477:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815120013056:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 108us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241294.761506:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 122 00000100:00080000:3.0:1782241294.761549:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241294.761939:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120013440 00000100:00100000:1.0:1782241294.761946:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120013440 00000100:00100000:1.0:1782241294.761989:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120012800 00000100:00100000:1.0:1782241294.761992:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120012800 00000100:00100000:1.0:1782241294.762012:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 296 00000100:00100000:1.0:1782241294.762019:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815120013440:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241294.762054:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815120013440:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 36us (5546us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241294.762062:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 296 00000100:00100000:1.0:1782241294.762074:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 297 00000100:00100000:1.0:1782241294.762079:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:2396:x1868815120012800:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241294.762103:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:2396:x1868815120012800:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 24us (4723us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241294.762109:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 297 00000100:00080000:3.0:1782241294.762316:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782241294.763602:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120013312 00000100:00100000:1.0:1782241294.763614:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120013312 00000100:00100000:1.0:1782241294.763664:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 298 00000100:00100000:1.0:1782241294.763672:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2396:x1868815120013312:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241294.764374:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2396:x1868815120013312:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 696us (3148us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241294.764455:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 298 00010000:00010000:3.0:1782241294.984377:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241295.622220:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140003840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241295.622321:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241295.624084:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140003840 00000100:00100000:2.0:1782241295.624116:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140003840 00000100:00100000:2.0:1782241295.640131:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1782241295.640169:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140003840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782241295.640233:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1782241295.640438:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140003840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 289us (18116us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241295.640448:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1782241295.640465:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140003840:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782241296.007010:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241296.647278:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140004224:0@lo:400:kworker.0 00000100:00100000:1.0:1782241296.647378:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241296.647469:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140004736:0@lo:400:kworker.0 00000100:00100000:1.0:1782241296.647502:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241296.647527:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140005248:0@lo:400:kworker.0 00000100:00100000:1.0:1782241296.647548:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241296.647573:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1782241296.647579:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815140004096:0@lo:400:kworker.0 00000100:00100000:1.0:1782241296.647598:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241296.647611:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140004608:0@lo:400:kworker.0 00000100:00100000:1.0:1782241296.647634:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241296.647651:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815140005120:0@lo:400:kworker.0 00000100:00100000:1.0:1782241296.647670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241296.647720:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140004736 00000100:00100000:1.0:1782241296.647730:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140004736 00000100:00100000:1.0:1782241296.647834:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140005248 00000100:00100000:1.0:1782241296.647842:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140005248 00000100:00100000:1.0:1782241296.647860:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140004096 00000100:00100000:1.0:1782241296.647862:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140004096 00000100:00100000:1.0:1782241296.647873:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140004608 00000100:00100000:1.0:1782241296.647875:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140004608 00000100:00100000:1.0:1782241296.647887:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140005120 00000100:00100000:1.0:1782241296.647889:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140005120 00000100:00100000:2.0:1782241296.648087:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140003968:0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.648149:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241296.648208:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140004480:0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.648236:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241296.648263:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140004992:0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.648290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241296.648311:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140005504:0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.648332:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241296.648357:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1782241296.648363:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140004352:0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.648403:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241296.648419:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140004864:0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.648441:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241296.648462:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140005376:0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.648482:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241296.648521:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140004992 00000100:00100000:2.0:1782241296.648526:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140004992 00000100:00100000:2.0:1782241296.648560:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140005504 00000100:00100000:2.0:1782241296.648563:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140005504 00000100:00100000:2.0:1782241296.648578:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140004864 00000100:00100000:2.0:1782241296.648580:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140004864 00000100:00100000:2.0:1782241296.648595:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140005376 00000100:00100000:2.0:1782241296.648597:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140005376 00000100:00100000:2.0:1782241296.648615:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1782241296.648624:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140004992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.648694:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140004992:12345-0@lo:400:kworker.0 Request processed in 69us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241296.648714:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1782241296.648734:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1782241296.648740:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815140005504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.648801:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815140005504:12345-0@lo:400:kworker.0 Request processed in 61us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241296.648809:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1782241296.648820:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1782241296.648825:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140004864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.648854:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140004864:12345-0@lo:400:kworker.0 Request processed in 29us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241296.648869:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1782241296.648880:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1782241296.648885:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140005376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.649106:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140005376:12345-0@lo:400:kworker.0 Request processed in 219us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241296.649113:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1782241296.649222:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140004864:0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.649235:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140005376:0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.649246:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140004992:0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.649257:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140005504:0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.649332:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140004224 00000100:00100000:2.0:1782241296.649338:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140004224 00000100:00100000:2.0:1782241296.649369:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140004480 00000100:00100000:2.0:1782241296.649372:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140004480 00000100:00100000:2.0:1782241296.649386:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1782241296.649392:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140004224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.649441:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140004224:12345-0@lo:400:kworker.0 Request processed in 49us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241296.649447:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1782241296.649459:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1782241296.649465:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140004480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.649502:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140004480:12345-0@lo:400:kworker.0 Request processed in 37us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241296.649508:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1782241296.649539:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140004352 00000100:00100000:2.0:1782241296.649543:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140004352 00000100:00100000:2.0:1782241296.649563:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1782241296.649570:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140004736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.649608:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140004736:12345-0@lo:400:kworker.0 Request processed in 38us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241296.649614:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1782241296.649626:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1782241296.649633:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815140005248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.649662:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815140005248:12345-0@lo:400:kworker.0 Request processed in 30us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241296.649668:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1782241296.649677:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1782241296.649684:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815140004096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.649726:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815140004096:12345-0@lo:400:kworker.0 Request processed in 42us (2127us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241296.649732:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1782241296.649743:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1782241296.649749:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815140004608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.649808:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815140004608:12345-0@lo:400:kworker.0 Request processed in 59us (2172us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241296.649814:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1782241296.649826:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1782241296.649833:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815140005120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.649866:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815140005120:12345-0@lo:400:kworker.0 Request processed in 34us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241296.649879:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1782241296.650088:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1782241296.650099:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140004352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241296.650151:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140004352:12345-0@lo:400:kworker.0 Request processed in 55us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241296.650157:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1782241296.650317:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815140004096:0@lo:400:kworker.0 00000100:00100000:1.0:1782241296.650498:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140004608:0@lo:400:kworker.0 00000100:00100000:1.0:1782241296.650510:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815140005120:0@lo:400:kworker.0 00000100:00100000:1.0:1782241296.650522:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140004224:0@lo:400:kworker.0 00010000:00080000:1.0:1782241296.650536:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47b8f480 x1868815140004736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241296.650548:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140004736:0@lo:400:kworker.0 00010000:00080000:1.0:1782241296.650560:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47b4fb80 x1868815140005248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241296.650568:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140005248:0@lo:400:kworker.0 00000100:00080000:3.0:1782241296.650825:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782241296.650833:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782241296.650837:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782241296.650840:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782241296.650857:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140003968 00000100:00100000:3.0:1782241296.650864:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140003968 00000100:00100000:3.0:1782241296.650930:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1782241296.650940:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b8a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815140003968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241296.650996:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b8a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815140003968:12345-0@lo:400:kworker.0 Request processed in 57us (2847us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241296.651003:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1782241296.651096:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140004352:0@lo:400:kworker.0 00000100:00100000:3.0:1782241296.651106:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140003968:0@lo:400:kworker.0 00000100:00100000:3.0:1782241296.651118:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140004480:0@lo:400:kworker.0 00000100:00100000:2.0:1782241296.654972:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782241296.655192:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4689bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140005632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241296.655294:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241296.655511:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140005632 00000100:00100000:1.0:1782241296.655522:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140005632 00000100:00100000:1.0:1782241296.655618:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1782241296.655629:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1868815140005632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782241296.655680:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782241296.655789:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1868815140005632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241296.655797:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1782241296.655898:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4689bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140005632:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782241297.044999:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241297.157066:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241297.157104:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140005760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241297.157215:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241297.157341:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140005760 00000100:00100000:0.0:1782241297.157367:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140005760 00000100:00100000:0.0:1782241297.157451:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782241297.157462:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140005760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241297.157499:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782241297.157578:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140005760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241297.157588:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782241297.157655:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140005760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241297.158196:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d46899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140005888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241297.158251:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241297.158444:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140005888 00000100:00100000:1.0:1782241297.158451:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140005888 00000100:00100000:1.0:1782241297.158496:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782241297.158505:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140005888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241297.158660:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241297.158726:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140005888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 221us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241297.158744:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1782241297.158877:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d46899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140005888:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1782241297.469995:0:14465:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 15:01:36 (1782241296) 00010000:00010000:1.0:1782241298.053394:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241298.694146:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d46898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140006016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241298.694273:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241298.694610:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140006016 00000100:00100000:1.0:1782241298.694623:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140006016 00000100:00080000:3.0:1782241298.694865:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241298.694896:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241298.694909:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140006144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241298.694959:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1782241298.698697:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:2.0:1782241298.698721:0:6489:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1782241298.698746:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1782241298.698788:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1782241298.715105:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140006144 00000100:00100000:1.0:1782241298.715131:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140006144 00000100:00080000:3.0:1782241298.715270:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241298.715325:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1782241298.715339:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140006016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782241298.715386:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241298.715585:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140006016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 249us (21312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241298.715594:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1782241298.715616:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1782241298.715625:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140006144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782241298.715641:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241298.715688:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d46898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140006016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241298.715703:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140006144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (20743us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241298.715710:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1782241298.715785:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140006144:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1782241298.731752:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000100:00100000:3.0:1782241298.982505:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241298.982989:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120013696 00000100:00100000:1.0:1782241298.983003:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120013696 00000100:00100000:1.0:1782241298.983125:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 150 00000100:00100000:1.0:1782241298.983140:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+13:12153:x1868815120013696:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782241298.983168:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241298.983196:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a0d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335052ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983354:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a0da lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983374:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a0da lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983392:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a0da lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983410:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e1a0e1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983418:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e1a0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983426:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e1a0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983564:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1a0e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983573:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1a0e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983580:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1a0e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241298.983592:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1782241298.983729:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a0da lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983737:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a0da lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983795:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a0da lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983803:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ebc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241298.983809:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a0da lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983818:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a0da lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983833:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff890e81fbcd00) 00010000:00010000:1.0:1782241298.983837:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241298.983843:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a0da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983850:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a0da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983865:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e1a0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983872:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e1a0e1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983878:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e1a0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983883:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241298.983886:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e1a0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983904:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e1a0e1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983912:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff890e81fbc100) 00010000:00010000:1.0:1782241298.983914:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241298.983918:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e1a0e1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.983923:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e1a0e1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.984300:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a0d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052ed expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.984318:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1a0e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052ed expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241298.984326:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890e81fbc300) 00010000:00010000:1.0:1782241298.984328:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241298.984331:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea800, rc 0) 00000100:00100000:1.0:1782241298.984428:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+15:12153:x1868815120013696:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 1292us (1948us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1782241298.984439:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 150 00000100:00080000:3.0:1782241298.985123:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241298.988110:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241298.988540:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120013824 00000100:00100000:3.0:1782241298.988554:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120013824 00000100:00100000:3.0:1782241298.988639:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 151 00000100:00100000:3.0:1782241298.988651:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4689a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+15:12153:x1868815120013824:12345-192.168.204.58@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1782241298.988857:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4689a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+15:12153:x1868815120013824:12345-192.168.204.58@tcp:59:lhsmtool_posix.0 Request processed in 207us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241298.988866:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 151 00000100:00100000:0.0:1782241298.993506:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241298.994887:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120013952 00000100:00100000:3.0:1782241298.994907:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120013952 00000100:00100000:1.0:1782241298.995207:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241298.995485:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:3.0:1782241298.995504:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e436c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+15:2399:x1868815120013952:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241298.995528:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241298.995565:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1a0e8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052ed expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241298.995591:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890e81fbc300) 00010000:00010000:3.0:1782241298.995597:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241298.995729:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120014080 00000100:00100000:2.0:1782241298.995735:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120014080 00000100:00100000:2.0:1782241298.995843:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 152 00000100:00100000:2.0:1782241298.995852:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:12153:x1868815120014080:12345-192.168.204.58@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1782241298.995972:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:12153:x1868815120014080:12345-192.168.204.58@tcp:59:lhsmtool_posix.0 Request processed in 121us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241298.995980:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 152 00000100:00100000:3.0:1782241298.996652:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e436c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:2399:x1868815120013952:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 1151us (3160us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241298.996690:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00080000:1.0:1782241298.996842:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1782241299.077651:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782241299.218160:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782241299.218175:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782241299.220096:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1782241299.220126:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1782241299.599474:0:13786:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782241299.869204:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241299.869274:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241299.869321:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241299.869352:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241299.869373:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120014208 00000100:00100000:1.0:1782241299.869379:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241299.869388:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120014208 00000100:00100000:1.0:1782241299.869400:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241299.869456:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 386 00000100:00100000:3.0:1782241299.869466:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b8a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2399:x1868815120014208:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241299.869483:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241299.869509:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120014464 00000100:00100000:1.0:1782241299.869514:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120014464 00000100:00100000:1.0:1782241299.869549:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120014976 00000100:00100000:1.0:1782241299.869552:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120014976 00000100:00100000:1.0:1782241299.869576:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120014336 00000100:00100000:1.0:1782241299.869579:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120014336 00000100:00100000:1.0:1782241299.869591:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120014848 00000100:00100000:1.0:1782241299.869593:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120014848 00000100:00100000:1.0:1782241299.869611:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 305 00000100:00100000:1.0:1782241299.869619:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4689aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815120014464:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241299.869621:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b8a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2399:x1868815120014208:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 157us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241299.869629:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 386 00000100:00100000:1.0:1782241299.869666:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4689aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815120014464:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 48us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241299.869673:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 305 00000100:00100000:3.0:1782241299.869686:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 306 00000100:00100000:1.0:1782241299.869690:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 307 00000100:00100000:3.0:1782241299.869693:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815120014976:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241299.869695:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4689b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:2399:x1868815120014336:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241299.869719:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4689b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:2399:x1868815120014336:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 22us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241299.869726:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 307 00000100:00100000:1.0:1782241299.869739:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 308 00000100:00100000:1.0:1782241299.869744:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2399:x1868815120014848:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241299.869863:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120014720 00000100:00100000:0.0:1782241299.869868:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120014720 00000100:00100000:0.0:1782241299.869913:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120014592 00000100:00100000:0.0:1782241299.869916:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120014592 00000100:00100000:2.0:1782241299.869971:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 127 00000100:00100000:2.0:1782241299.869981:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815120014720:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241299.870999:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815120014976:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 1299us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241299.871012:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 306 00000100:00100000:0.0:1782241299.871746:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 128 00000100:00100000:0.0:1782241299.871782:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815120014592:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241299.871858:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815120014592:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 101us (2455us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241299.871865:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 128 00000100:00080000:0.0:1782241299.877049:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782241299.877066:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782241299.877071:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241299.877075:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782241299.881432:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2399:x1868815120014848:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 11665us (11925us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241299.881453:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 308 00000100:00100000:2.0:1782241299.883156:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815120014720:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 13161us (13818us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241299.883176:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 127 00010000:00010000:2.0:1782241300.106289:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782241300.614813:0:13786:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1782241300.742058:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782241300.742086:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140006272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782241300.742172:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241300.742841:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140006272 00000100:00100000:0.0:1782241300.742850:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140006272 00000100:00100000:0.0:1782241300.742896:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1782241300.742905:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140006272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241300.742940:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1782241300.743015:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140006272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241300.743022:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1782241300.743177:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140006272:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782241301.127059:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782241301.253030:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782241301.253037:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782241301.253141:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1782241301.253148:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782241301.346521:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241301.347329:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120015104 00000100:00100000:3.0:1782241301.347338:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120015104 00000100:00100000:3.0:1782241301.347415:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 153 00000100:00100000:3.0:1782241301.347425:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:12195:x1868815120015104:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241301.347445:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241301.347465:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a0f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335052f4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347530:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a0fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347544:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a0fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347563:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a0fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347578:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a104 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347585:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a104 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347590:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a104 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347646:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a0fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347652:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a0fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347658:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a0fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347664:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241301.347669:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a0fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347676:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a0fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347687:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b500) 00010000:00010000:3.0:1782241301.347691:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241301.347695:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a0fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347707:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a0fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347719:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a104 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347725:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a104 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347731:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a104 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347737:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241301.347740:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a104 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347746:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a104 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347774:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff890e528b3100) 00010000:00010000:3.0:1782241301.347777:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241301.347781:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a104 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.347787:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a104 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782241301.349835:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782241301.350186:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a0f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052f4 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.350214:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b500) 00010000:00010000:3.0:1782241301.350217:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241301.350223:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a0f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052f4 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.350235:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164ca00, rc 0) 00000100:00100000:3.0:1782241301.350309:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:12195:x1868815120015104:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 2884us (3797us total) trans 0 rc 301/301 00000100:00100000:3.0:1782241301.350318:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 153 00000100:00100000:0.0:1782241301.364190:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241301.364350:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120015360 00000100:00100000:2.0:1782241301.364365:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120015360 00000100:00100000:2.0:1782241301.364438:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 154 00000100:00100000:2.0:1782241301.364450:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4684df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:12195:x1868815120015360:12345-192.168.204.58@tcp:36:lfs.0 00010000:00010000:2.0:1782241301.364519:0:10147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241301.364556:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e19a4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505118 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.364575:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b500) 00010000:00010000:2.0:1782241301.364580:0:10147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241301.364661:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a10b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.364676:0:10147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a0cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052e6 expref: 5 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.364686:0:10147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a10b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.364721:0:10147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a0cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052e6 expref: 5 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.364748:0:10147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a0cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052e6 expref: 5 pid: 6510 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241301.364845:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4789fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140006400:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241301.364985:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d478e9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241301.391879:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241301.392236:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120015488 00000100:00100000:0.0:1782241301.392245:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120015488 00010000:00010000:0.0:1782241301.392302:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a0cc lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052e6 expref: 6 pid: 6510 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241301.392337:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 78 00000100:00100000:0.0:1782241301.392348:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2398:x1868815120015488:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241301.392364:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241301.392371:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a0cc lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052e6 expref: 6 pid: 6510 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.392385:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a0cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052e6 expref: 6 pid: 6510 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.392409:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b500) 00010000:00010000:0.0:1782241301.392415:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a10b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.392435:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a10b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.392443:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a10b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.392463:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241301.392518:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4689bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2398:x1868815120015488:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 170us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241301.392526:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 78 00000100:00080000:0.0:1782241301.392550:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782241301.392809:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a0cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052e6 expref: 5 pid: 6510 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241301.392826:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4789fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140006400:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241301.392847:0:10147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a10b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.392856:0:10147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a10b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.392862:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a10b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.392887:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a112 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.392896:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a112 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.392904:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a112 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.393442:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a119 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.393458:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a119 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.393465:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a119 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782241301.393481:0:10147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f68b8c2 reply state 0000000012a83529 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a119 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.393493:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a119 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.393500:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:2.0:1782241301.393503:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782241301.393506:0:10147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782241301.393512:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1782241301.393518:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a10b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.393524:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a10b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.393531:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a10b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.393537:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241301.393542:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a10b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.393549:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a10b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.393572:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b500) 00010000:00010000:2.0:1782241301.393574:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241301.393578:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a10b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.393583:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a10b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782241301.393600:0:10147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f68b8c2 reply state 0000000012a83529 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a112 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.393607:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a112 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.393625:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff890d4781cd00) 00010000:00010000:2.0:1782241301.393627:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782241301.393628:0:10147:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1782241301.393705:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4684df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+15:12195:x1868815120015360:12345-192.168.204.58@tcp:36:lfs.0 Request processed in 29257us (29525us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1782241301.393714:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 154 00000100:00100000:1.0:1782241301.530645:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241301.530795:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120015616 00000100:00100000:0.0:1782241301.530805:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120015616 00000100:00100000:0.0:1782241301.530867:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 155 00000100:00100000:0.0:1782241301.530878:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+15:12203:x1868815120015616:12345-192.168.204.58@tcp:101:lctl.0 00010000:00010000:0.0:1782241301.530904:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241301.530927:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a120 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335052fb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.531073:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a127 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.531088:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a127 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.531099:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a127 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241301.531154:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782241301.531165:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241301.531187:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a127 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.531213:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a120 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052fb expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.531231:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a127 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052fb expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.531239:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b100) 00010000:00010000:0.0:1782241301.531242:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782241301.531245:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1200, rc 0) 00000100:00100000:0.0:1782241301.531312:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+16:12203:x1868815120015616:12345-192.168.204.58@tcp:101:lctl.0 Request processed in 435us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241301.531320:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 155 00000100:00100000:1.0:1782241301.586300:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241301.586396:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120015744 00000100:00100000:3.0:1782241301.586406:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120015744 00000100:00100000:3.0:1782241301.586459:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 156 00000100:00100000:3.0:1782241301.586468:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+16:12209:x1868815120015744:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:3.0:1782241301.586495:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241301.586514:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a12e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505302 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586573:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a135 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586587:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a135 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586598:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a135 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586623:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a13c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586644:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a13c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586651:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a13c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586739:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a143 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586748:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a143 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586799:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a143 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241301.586836:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1782241301.586839:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782241301.586858:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a143 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586871:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a135 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586877:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a135 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586884:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a135 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586889:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241301.586893:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a135 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586908:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a135 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586920:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b100) 00010000:00010000:3.0:1782241301.586923:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241301.586927:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a135 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586932:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a135 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586946:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a13c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.586952:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a13c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.587081:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a13c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.587087:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241301.587090:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a13c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.587097:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a13c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.587110:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff890d4781cd00) 00010000:00010000:3.0:1782241301.587113:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241301.587116:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a13c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.587268:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a13c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.587301:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a12e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505302 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.587315:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a143 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505302 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.587322:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:3.0:1782241301.587324:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782241301.587327:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c200, rc 0) 00000100:00100000:2.0:1782241301.589268:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+17:12209:x1868815120015744:12345-192.168.204.58@tcp:101:bash.0 Request processed in 2792us (2967us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241301.589281:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 156 00000100:00100000:2.0:1782241301.595408:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241301.595507:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120016000 00000100:00100000:0.0:1782241301.595516:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120016000 00000100:00100000:0.0:1782241301.595568:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 157 00000100:00100000:0.0:1782241301.595577:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4789fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+17:12209:x1868815120016000:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:0.0:1782241301.595597:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241301.595626:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a14a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505309 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.595725:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a151 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.595740:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a151 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.595809:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a151 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.595828:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a158 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.595835:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a158 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.595842:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a158 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782241301.596185:0:10147:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1782241301.596306:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a15f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.596315:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a15f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.596323:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a15f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.596350:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a151 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.596357:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a151 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.596364:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a151 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.596369:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241301.596379:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a151 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.596386:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a151 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.596398:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:0.0:1782241301.596400:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241301.596404:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a151 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.596410:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a151 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782241301.596423:0:10147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000052b0ab1e reply state 000000002686ac5d transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a158 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.596434:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a158 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.596440:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890d4195b600) 00010000:00010000:0.0:1782241301.596442:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782241301.596444:0:10147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782241301.596470:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a14a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505309 expref: 20 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.596482:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a15f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505309 expref: 19 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.596489:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:0.0:1782241301.596491:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782241301.596498:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0600, rc 0) 00000100:00100000:0.0:1782241301.596549:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4789fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:12209:x1868815120016000:12345-192.168.204.58@tcp:101:bash.0 Request processed in 973us (1149us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1782241301.596557:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 157 00000100:00100000:1.0:1782241301.604793:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241301.604934:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120016128 00000100:00100000:3.0:1782241301.604944:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120016128 00000100:00100000:3.0:1782241301.605017:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 55 00000100:00100000:3.0:1782241301.605037:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815120016128:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:3.0:1782241301.605056:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241301.605077:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052bbc522/0xc9959f2fb1e1a16d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505310 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782241301.605101:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241301.605121:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=364s v=(0 0) 00010000:00010000:3.0:1782241301.605126:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241301.605134:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052bbc522/0xc9959f2fb1e1a16d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505310 expref: 6 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.605187:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000052bbc522/0xc9959f2fb1e1a16d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505310 expref: 6 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.605201:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164ca00, rc 0) 00000100:00100000:3.0:1782241301.605259:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815120016128:12345-192.168.204.58@tcp:101:bash.0 Request processed in 232us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241301.605266:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 55 00000100:00080000:0.0:1782241301.605384:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241301.610007:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241301.610081:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120016256 00000100:00100000:0.0:1782241301.610092:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120016256 00000100:00100000:0.0:1782241301.610148:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 56 00000100:00100000:0.0:1782241301.610475:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:12209:x1868815120016256:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:0.0:1782241301.610495:0:8747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241301.610514:0:8747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505317 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.610548:0:8747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000052bbc522/0xc9959f2fb1e1a16d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505310 expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.610559:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241301.610564:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241301.610570:0:8747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505317 expref: 7 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.610642:0:8747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000052bbc522/0xc9959f2fb1e1a16d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505310 expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.610656:0:8747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000052bbc522/0xc9959f2fb1e1a16d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505310 expref: 7 pid: 8426 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241301.610683:0:8747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48202680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:8747:1868815140006528:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241301.610827:0:8747:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810900 going to sleep for 11 seconds 00000100:00100000:3.0:1782241301.616569:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241301.616619:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120016384 00000100:00100000:3.0:1782241301.616628:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120016384 00010000:00010000:3.0:1782241301.616669:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000052bbc522/0xc9959f2fb1e1a16d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505310 expref: 8 pid: 8426 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241301.616706:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 79 00000100:00100000:3.0:1782241301.616718:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2399:x1868815120016384:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241301.616734:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241301.616771:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000052bbc522/0xc9959f2fb1e1a16d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505310 expref: 8 pid: 8426 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.616790:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000052bbc522/0xc9959f2fb1e1a16d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505310 expref: 8 pid: 8426 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.616829:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241301.616834:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241301.616853:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505317 expref: 8 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.616853:0:8747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052bbc522/0xc9959f2fb1e1a16d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505310 expref: 8 pid: 8426 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.616865:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505317 expref: 8 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241301.616870:0:8747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48202680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:8747:1868815140006528:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241301.616900:0:8747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505317 expref: 7 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.616901:0:10330:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505317 expref: 7 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.616910:0:8747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0200, rc 0) 00000100:00100000:3.0:1782241301.616915:0:10330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77858000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10330:1868815140006656:192.168.204.58@tcp:105: 00000100:00100000:2.0:1782241301.616972:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:12209:x1868815120016256:12345-192.168.204.58@tcp:101:bash.0 Request processed in 6815us (6974us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241301.616980:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 56 00000100:00100000:3.0:1782241301.616981:0:10330:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4776ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241301.621958:0:10330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77858000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10330:1868815140006656:192.168.204.58@tcp:105: 00010000:00010000:3.0:1782241301.621988:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241301.622114:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815120016384:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 5396us (5555us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241301.622127:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 79 00000100:00100000:1.0:1782241301.623476:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241301.628489:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120016640 00000100:00100000:0.0:1782241301.628504:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120016640 00000100:00100000:0.0:1782241301.628574:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 36 00000100:00100000:0.0:1782241301.628584:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:12209:x1868815120016640:12345-192.168.204.58@tcp:35:bash.0 00000001:00080000:0.0:1782241301.629369:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967421 00000100:00100000:0.0:1782241301.629737:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:12209:x1868815120016640:12345-192.168.204.58@tcp:35:bash.0 Request processed in 1151us (6265us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1782241301.629748:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 36 00000020:00080000:0.0:1782241301.629772:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782241301.753346:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241301.753508:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120016896 00000100:00100000:0.0:1782241301.753517:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120016896 00000100:00100000:0.0:1782241301.753584:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 158 00000100:00100000:0.0:1782241301.753595:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:12219:x1868815120016896:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241301.753629:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241301.753648:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a17b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350531e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241301.753805:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1782241301.753909:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a17b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350531e expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.753923:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b100) 00010000:00010000:0.0:1782241301.753927:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782241301.753947:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a17b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350531e expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.753962:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1600, rc 0) 00000100:00100000:0.0:1782241301.754017:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+23:12219:x1868815120016896:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 423us (679us total) trans 4294967423 rc 301/301 00000100:00100000:0.0:1782241301.754024:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 158 00000100:00100000:1.0:1782241301.760121:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241301.760222:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120017152 00000100:00100000:3.0:1782241301.760232:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120017152 00000100:00100000:0.0:1782241301.760386:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 37 00000100:00100000:0.0:1782241301.760400:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+23:12219:x1868815120017152:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:0.0:1782241301.760651:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+24:12219:x1868815120017152:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 254us (538us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1782241301.760659:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 37 00000100:00100000:0.0:1782241301.766898:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241301.766921:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140006784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241301.766994:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241301.767133:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140006784 00000100:00100000:1.0:1782241301.767140:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140006784 00000100:00100000:1.0:1782241301.767204:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1782241301.767214:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140006784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782241301.767246:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782241301.767308:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140006784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241301.767315:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1782241301.767354:0:3638:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1782241301.767361:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff890e47ae8a80, transno 4294967313 00000100:00100000:1.0:1782241301.767378:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140006784:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782241301.768131:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782241301.769887:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140006912:0@lo:400:kworker.0 00000100:00100000:3.0:1782241301.769893:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140007168:0@lo:400:kworker.0 00000100:00100000:0.0:1782241301.769961:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e77859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140007040:0@lo:400:kworker.0 00000100:00100000:2.0:1782241301.769964:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140007296:0@lo:400:kworker.0 00000100:00100000:3.0:1782241301.773889:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241301.773962:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140007680:0@lo:400:kworker.0 00000100:00100000:3.0:1782241301.774001:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241301.774034:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140008192:0@lo:400:kworker.0 00000100:00100000:3.0:1782241301.774056:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241301.774113:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140007168 00000100:00100000:3.0:1782241301.774121:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140007168 00000100:00100000:3.0:1782241301.774322:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1782241301.774330:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140007168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241301.774387:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140007168:12345-0@lo:400:kworker.0 Request processed in 58us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241301.774394:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1782241301.774441:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140007168:0@lo:400:kworker.0 00000100:00100000:3.0:1782241301.774489:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140007680 00000100:00100000:3.0:1782241301.774493:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140007680 00000100:00100000:3.0:1782241301.774528:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140008192 00000100:00100000:3.0:1782241301.774531:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140008192 00000100:00100000:3.0:1782241301.774553:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1782241301.774558:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140007680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241301.774591:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140007680:12345-0@lo:400:kworker.0 Request processed in 33us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241301.774596:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1782241301.774620:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1782241301.774626:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815140008192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241301.774651:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815140008192:12345-0@lo:400:kworker.0 Request processed in 25us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241301.774656:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:3.0:1782241301.774671:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1782241301.774701:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48134700 x1868815140007680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241301.774721:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140007680:0@lo:400:kworker.0 00010000:00080000:3.0:1782241301.774733:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48251500 x1868815140008192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241301.774754:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140008192:0@lo:400:kworker.0 00000100:00100000:1.0:1782241301.776928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241301.776983:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140007424:0@lo:400:kworker.0 00000100:00100000:1.0:1782241301.777021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241301.777408:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140007936:0@lo:400:kworker.0 00000100:00100000:1.0:1782241301.777436:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241301.777485:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140007424 00000100:00100000:1.0:1782241301.777505:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140007424 00000100:00100000:1.0:1782241301.777553:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1782241301.777561:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140007424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241301.777637:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140007424:12345-0@lo:400:kworker.0 Request processed in 76us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241301.777646:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1782241301.777671:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140007936 00000100:00100000:1.0:1782241301.777674:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140007936 00000100:00100000:1.0:1782241301.777709:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1782241301.777716:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140007936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241301.777746:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140007936:12345-0@lo:400:kworker.0 Request processed in 30us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241301.777752:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1782241301.777945:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140006912 00000100:00100000:3.0:1782241301.777951:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140006912 00000100:00100000:3.0:1782241301.777980:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1782241301.777987:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815140006912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241301.778021:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815140006912:12345-0@lo:400:kworker.0 Request processed in 34us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241301.778039:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1782241301.778418:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241301.778467:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815140007552:0@lo:400:kworker.0 00000100:00100000:0.0:1782241301.778491:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241301.778507:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815140008064:0@lo:400:kworker.0 00000100:00100000:0.0:1782241301.778525:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241301.778586:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140006912:0@lo:400:kworker.0 00000100:00100000:0.0:1782241301.778600:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140007424:0@lo:400:kworker.0 00000100:00100000:0.0:1782241301.778625:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140007936:0@lo:400:kworker.0 00000100:00080000:0.0:1782241301.778680:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241301.779495:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241301.779535:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140007808:0@lo:400:kworker.0 00000100:00100000:2.0:1782241301.779558:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241301.779591:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140007808 00000100:00100000:2.0:1782241301.779596:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140007808 00000100:00100000:2.0:1782241301.779656:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1782241301.779665:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140007808:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782241301.779920:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241301.779923:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140007808:12345-0@lo:400:kworker.0 Request processed in 258us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241301.779931:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1782241301.779963:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140007808:0@lo:400:kworker.0 00000100:00100000:2.0:1782241301.779972:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140008320:0@lo:400:kworker.0 00000100:00100000:2.0:1782241301.779993:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241301.780390:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140008320 00000100:00100000:1.0:1782241301.780396:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140008320 00000100:00100000:1.0:1782241301.780441:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1782241301.780449:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140008320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241301.780489:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140008320:12345-0@lo:400:kworker.0 Request processed in 40us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241301.780495:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1782241301.780592:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140007040 00000100:00100000:3.0:1782241301.780597:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140007040 00000100:00100000:3.0:1782241301.780639:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140007552 00000100:00100000:3.0:1782241301.780642:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140007552 00000100:00100000:3.0:1782241301.780655:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140008064 00000100:00100000:3.0:1782241301.780658:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140008064 00000100:00100000:3.0:1782241301.780668:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140007296 00000100:00100000:3.0:1782241301.780670:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140007296 00000100:00100000:3.0:1782241301.780682:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1782241301.780688:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140007040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241301.780733:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140007040:12345-0@lo:400:kworker.0 Request processed in 44us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241301.780739:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1782241301.780752:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1782241301.780915:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1782241301.780939:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815140007552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241301.780971:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815140007552:12345-0@lo:400:kworker.0 Request processed in 189us (2479us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241301.780978:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1782241301.781004:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00080000:2.0:1782241301.781047:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241301.781238:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815140008064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241301.781360:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140007296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241301.781444:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e77859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140007040:0@lo:400:kworker.0 00000100:00100000:1.0:1782241301.781456:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815140007552:0@lo:400:kworker.0 00000100:00100000:1.0:1782241301.781466:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815140008064:0@lo:400:kworker.0 00000100:00100000:3.0:1782241301.781592:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140007296:12345-0@lo:400:kworker.0 Request processed in 580us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241301.781600:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1782241301.781653:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140007296:0@lo:400:kworker.0 00000100:00100000:3.0:1782241301.781668:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140008320:0@lo:400:kworker.0 00000100:00100000:0.0:1782241301.781722:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815140008064:12345-0@lo:400:kworker.0 Request processed in 800us (3195us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241301.781729:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00080000:2.0:1782241301.784275:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782241301.875716:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241301.878655:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120017280 00000100:00100000:3.0:1782241301.878669:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120017280 00000100:00100000:3.0:1782241301.878748:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 159 00000100:00100000:3.0:1782241301.879024:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+24:12225:x1868815120017280:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241301.879050:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241301.879072:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a189 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505325 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.879401:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a190 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.880043:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a190 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.880058:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a190 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241301.880107:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1782241301.880111:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782241301.880390:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a190 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.880446:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a189 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505325 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.880467:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a190 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505325 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.880477:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:3.0:1782241301.880480:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782241301.880484:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d800, rc 0) 00000100:00100000:3.0:1782241301.881732:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+25:12225:x1868815120017280:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 2956us (6007us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241301.881743:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 159 00000100:00100000:2.0:1782241301.895427:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241301.895670:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120017536 00000100:00100000:3.0:1782241301.895680:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120017536 00000100:00100000:3.0:1782241301.895749:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 160 00000100:00100000:3.0:1782241301.895799:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+25:12225:x1868815120017536:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241301.895820:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241301.896550:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a197 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350532c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.896684:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a19e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.896699:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a19e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.896711:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a19e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241301.896722:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782241301.896863:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a197 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350532c expref: 28 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.896880:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a19e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350532c expref: 27 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241301.896889:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:2.0:1782241301.896892:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241301.896895:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fac200, rc 0) 00000100:00100000:2.0:1782241301.896970:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:12225:x1868815120017536:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 1212us (1555us total) trans 4294967425 rc 0/0 00000100:00100000:2.0:1782241301.896979:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 160 00000100:00100000:1.0:1782241301.909249:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241301.915084:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120017664 00000100:00100000:3.0:1782241301.915098:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120017664 00000100:00100000:3.0:1782241301.915183:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:3.0:1782241301.915195:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:2399:x1868815120017664:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241301.915213:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241301.915238:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a19e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350532c expref: 27 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.915259:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:3.0:1782241301.915278:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241301.915347:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+26:2399:x1868815120017664:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 154us (6108us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241301.915357:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:3.0:1782241301.915479:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241301.915988:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120017920 00000100:00100000:1.0:1782241301.915994:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120017920 00000100:00100000:1.0:1782241301.916039:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 161 00000100:00100000:1.0:1782241301.916059:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+26:12225:x1868815120017920:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241301.916081:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241301.916096:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a1ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505333 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.916201:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e1a1b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.916216:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e1a1b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.916227:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e1a1b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241301.916240:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782241301.916344:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a1ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505333 expref: 29 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.916360:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e1a1b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505333 expref: 28 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.916367:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:1.0:1782241301.916370:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782241301.916372:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea200, rc 0) 00000100:00100000:1.0:1782241301.916420:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+28:12225:x1868815120017920:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 373us (941us total) trans 4294967426 rc 0/0 00000100:00100000:1.0:1782241301.916438:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 161 00000100:00100000:2.0:1782241301.923577:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241301.923698:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120018048 00000100:00100000:1.0:1782241301.923707:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120018048 00000100:00100000:1.0:1782241301.923813:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 57 00000100:00100000:1.0:1782241301.923823:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2398:x1868815120018048:12345-192.168.204.58@tcp:1:lfs.0 00010000:00010000:1.0:1782241301.923869:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1a1c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.923887:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505317 expref: 6 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.923895:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782241301.923899:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782241301.923903:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1a1c1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.923940:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505317 expref: 6 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.923953:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505317 expref: 6 pid: 8747 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241301.923967:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48356680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8423:1868815140008448:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241301.924705:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48527f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782241301.930868:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48356680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8423:1868815140008448:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241301.930913:0:8423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1a1c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241301.931392:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241301.931582:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120018176 00000100:00100000:1.0:1782241301.931589:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120018176 00002000:00100000:1.0:1782241301.931649:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff890d47b4f480 x1868815120018176/t0(0) o4->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:392/0 lens 504/0 e 0 to 0 dl 1782241312 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782241301.931659:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d47b4f480 with x1868815120018176 ext(0->12) 00010000:00010000:1.0:1782241301.931667:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505317 expref: 7 pid: 8747 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.931680:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505317 expref: 7 pid: 8747 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782241301.931687:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff890d47b4f480 00000100:00100000:1.0:1782241301.931719:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 2 00000100:00100000:1.0:1782241301.931728:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2399:x1868815120018176:12345-192.168.204.58@tcp:4:lfs.0 00000100:00100000:1.0:1782241301.932986:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2399:x1868815120018176:12345-192.168.204.58@tcp:4:lfs.0 Request processed in 1252us (1589us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1782241301.932996:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 2 00002000:00100000:1.0:1782241301.933005:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff890d47b4f480 x1868815120018176/t4294967306(0) o4->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:392/0 lens 504/448 e 0 to 0 dl 1782241312 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782241301.933014:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d47b4f480 with x1868815120018176 ext(0->12) 00010000:00010000:1.0:1782241301.933023:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505317 expref: 9 pid: 8747 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.933550:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505317 expref: 9 pid: 8747 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782241301.933559:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff890d47b4f480 00000100:00100000:2.0:1782241301.937418:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241301.937542:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120018304 00000100:00100000:0.0:1782241301.937553:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120018304 00010000:00010000:0.0:1782241301.937595:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505317 expref: 9 pid: 8747 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241301.937649:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 80 00000100:00100000:0.0:1782241301.937659:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2399:x1868815120018304:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241301.937675:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1782241301.937694:0:6495:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1782241301.937697:0:6495:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1782241302 00002000:00010000:0.0:1782241301.937699:0:6495:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1782241302 00002000:00010000:0.0:1782241301.937701:0:6495:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1782241302 00002000:00010000:0.0:1782241301.937704:0:6495:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1782241301.937710:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505317 expref: 9 pid: 8747 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.937725:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505317 expref: 9 pid: 8747 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.937797:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1a174 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505317 expref: 9 pid: 8747 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.937830:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782241301.937834:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782241301.937841:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1a1c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.937852:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1a1c1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.937878:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241301.937939:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2399:x1868815120018304:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 280us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241301.937947:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 80 00010000:00010000:1.0:1782241301.939071:0:8423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1a1c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.939084:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1a1c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.939110:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1a1c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.939117:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1a1c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.939125:0:8423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1a1c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.939132:0:8423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241301.939136:0:8423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1a1c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.939145:0:8423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1a1c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.939179:0:8423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1a1c1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241301.939186:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aecf6646/0xc9959f2fb1e1a1c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241301.939312:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2398:x1868815120018048:12345-192.168.204.58@tcp:1:lfs.0 Request processed in 15488us (15741us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241301.939322:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 57 00000100:00100000:2.0:1782241301.948875:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241301.949161:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120018560 00000100:00100000:0.0:1782241301.949171:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120018560 00000100:00100000:0.0:1782241301.949231:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 38 00000100:00100000:0.0:1782241301.949242:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47a48050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+28:12225:x1868815120018560:12345-192.168.204.58@tcp:35:lfs.0 00000004:00010000:0.0:1782241301.949309:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e1a1b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505333 expref: 28 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782241301.949533:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:0.0:1782241301.949567:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1782241301.949929:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1782241301.949969:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a1c8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.949983:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a15f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505309 expref: 32 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.949999:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a1c8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.950236:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a15f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505309 expref: 32 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.950253:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a15f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505309 expref: 32 pid: 10147 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241301.950268:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1868815140008576:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241301.950359:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810900 going to sleep for 11 seconds 00000100:00100000:2.0:1782241301.954287:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241301.954402:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120018688 00000100:00100000:3.0:1782241301.954412:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120018688 00010000:00010000:3.0:1782241301.954452:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a15f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505309 expref: 33 pid: 10147 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241301.954499:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 81 00000100:00100000:3.0:1782241301.954509:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+33:2398:x1868815120018688:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241301.954524:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241301.954531:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a15f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505309 expref: 33 pid: 10147 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.954544:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a15f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505309 expref: 33 pid: 10147 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.954565:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:3.0:1782241301.954570:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a1c8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.954580:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a1c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.954587:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a1c8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.954644:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241301.954701:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+33:2398:x1868815120018688:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 194us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241301.954710:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 81 00010000:00010000:0.0:1782241301.955068:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a15f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505309 expref: 32 pid: 10147 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241301.955088:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1868815140008576:192.168.204.58@tcp:104: 00010000:00010000:0.0:1782241301.955112:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a1c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.955122:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a1c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.955129:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a1c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782241301.955241:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000001:00080000:0.0:1782241301.955357:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:0.0:1782241301.955448:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1868815140008704:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782241301.955512:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241301.955565:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4b25f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241301.955587:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140008704 00000100:00100000:0.0:1782241301.955592:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140008704 00000100:00100000:0.0:1782241301.955643:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1782241301.955650:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1868815140008704:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782241301.955735:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1868815140008704:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241301.955742:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1782241301.955816:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1868815140008704:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1782241301.955918:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00000100:00100000:0.0:1782241301.955959:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1868815140008832:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782241301.955985:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241301.956005:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afd300 going to sleep for 11 seconds 00000100:00100000:0.0:1782241301.956018:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140008832 00000100:00100000:0.0:1782241301.956021:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140008832 00000100:00100000:0.0:1782241301.956044:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1782241301.956050:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6513:x1868815140008832:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782241301.956141:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6513:x1868815140008832:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (154us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1782241301.956148:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1782241301.956178:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1868815140008832:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1782241301.956206:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:0.0:1782241301.956232:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a1c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.956241:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a1c8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.956254:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a1c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.956260:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241301.956264:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a1c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.956273:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a1c8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.956286:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:0.0:1782241301.956290:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1782241301.956294:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a1c8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241301.956300:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a1c8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782241301.956384:0:6513:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1782241301.956440:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1782241301.956452:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365214694229ns, next at 366214692106ns, rc = 0 00000001:00080000:0.0:1782241301.956457:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967434 00010000:00010000:0.0:1782241301.956478:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:0.0:1782241301.956481:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782241301.956487:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea200/0xc9959f2fb1e1a1b3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505333 expref: 36 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241301.956566:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47a48050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+35:12225:x1868815120018560:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 7327us (7701us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1782241301.956583:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 38 00000020:00080000:0.0:1782241301.956587:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1782241301.962659:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241301.962872:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120018816 00000100:00100000:3.0:1782241301.962882:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120018816 00000100:00100000:3.0:1782241301.962945:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 162 00000100:00100000:3.0:1782241301.962956:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+35:12225:x1868815120018816:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241301.962984:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241301.963011:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a1cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350533a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.963086:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a1cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350533a expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.963101:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a1cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350533a expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241301.963120:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:3.0:1782241301.963123:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782241301.963127:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d200, rc 0) 00000100:00100000:3.0:1782241301.963185:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+36:12225:x1868815120018816:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 232us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241301.963193:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 162 00000100:00100000:2.0:1782241301.974871:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241301.975024:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120019072 00000100:00100000:3.0:1782241301.975033:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120019072 00000100:00100000:3.0:1782241301.975112:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 39 00000100:00100000:3.0:1782241301.975121:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+36:12225:x1868815120019072:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:3.0:1782241301.975352:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+37:12225:x1868815120019072:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 232us (490us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1782241301.975361:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 39 00000100:00100000:0.0:1782241302.101495:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241302.101611:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120019328 00000100:00100000:3.0:1782241302.101622:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120019328 00000100:00100000:3.0:1782241302.101679:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 163 00000100:00100000:3.0:1782241302.101690:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+37:12235:x1868815120019328:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241302.101718:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241302.101739:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a1d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505341 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241302.101907:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1782241302.102003:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a1d6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505341 expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241302.102019:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b100) 00010000:00010000:3.0:1782241302.102023:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782241302.102028:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a1d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505341 expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241302.102059:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d000, rc 0) 00000100:00100000:3.0:1782241302.102115:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+38:12235:x1868815120019328:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 427us (628us total) trans 4294967437 rc 301/301 00000100:00100000:3.0:1782241302.102123:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 163 00000100:00100000:2.0:1782241302.114307:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241302.114422:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120019456 00000100:00100000:1.0:1782241302.114432:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120019456 00000100:00100000:1.0:1782241302.114495:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 164 00000100:00100000:1.0:1782241302.114505:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+38:12235:x1868815120019456:12345-192.168.204.58@tcp:34:lfs.0 00010000:00010000:1.0:1782241302.114588:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a1e4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114618:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a1e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114631:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a1e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114644:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a1eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114652:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a1eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114675:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a1eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114752:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a1f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114817:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a1f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114824:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a1f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782241302.114872:0:10147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a1f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114884:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a1e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114890:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a1e4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114896:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a1e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114903:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241302.114906:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a1e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114914:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a1e4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114926:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:1.0:1782241302.114937:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241302.114942:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a1e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114947:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a1e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114962:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a1eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114969:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a1eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114975:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a1eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114980:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241302.114983:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a1eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114989:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a1eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.114997:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890d4195b600) 00010000:00010000:1.0:1782241302.115000:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241302.115003:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a1eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.115009:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a1eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.115018:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a1f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.115030:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a1f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.115036:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a1f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.115041:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241302.115045:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a1f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.115051:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a1f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.115060:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241302.115062:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241302.115065:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a1f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.115072:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a1f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241302.115142:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+38:12235:x1868815120019456:12345-192.168.204.58@tcp:34:lfs.0 Request processed in 637us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241302.115151:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 164 00000100:00100000:0.0:1782241302.124476:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241302.124614:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120019712 00000100:00100000:3.0:1782241302.124638:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120019712 00000100:00100000:3.0:1782241302.124696:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 40 00000100:00100000:3.0:1782241302.124706:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+38:12235:x1868815120019712:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:3.0:1782241302.124984:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+39:12235:x1868815120019712:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 278us (521us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1782241302.124993:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 40 00010000:00010000:1.0:1782241302.148922:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241302.182200:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241302.182286:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120019968 00000100:00100000:2.0:1782241302.182296:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120019968 00000100:00100000:2.0:1782241302.182358:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 165 00000100:00100000:2.0:1782241302.182367:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+39:12238:x1868815120019968:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241302.182392:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241302.182411:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a1f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505348 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182494:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a200 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182508:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a200 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182518:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a200 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182529:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a207 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182536:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182541:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182656:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a20e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182677:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a20e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182685:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a20e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241302.182696:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782241302.182814:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a200 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182822:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a200 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182829:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a200 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182835:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241302.182839:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a200 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182847:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a200 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182860:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:2.0:1782241302.182863:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241302.182867:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a200 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182874:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a200 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182888:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a207 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182900:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a207 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182906:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a207 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182910:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241302.182914:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a207 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182919:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a207 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182928:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890d4195b600) 00010000:00010000:2.0:1782241302.182930:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241302.182933:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a207 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182939:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a207 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182975:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a1f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505348 expref: 42 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182988:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a20e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505348 expref: 41 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.182995:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241302.182998:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241302.183007:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43faca00, rc 0) 00000100:00100000:2.0:1782241302.183084:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+41:12238:x1868815120019968:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 717us (892us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1782241302.183093:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 165 00000100:00100000:2.0:1782241302.192323:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241302.192810:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120020096 00000100:00100000:1.0:1782241302.192821:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120020096 00000100:00100000:1.0:1782241302.192883:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 166 00000100:00100000:1.0:1782241302.192893:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+41:12238:x1868815120020096:12345-192.168.204.58@tcp:54:lfs.0 00010000:00010000:1.0:1782241302.192979:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a21c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.192995:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a21c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.193006:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a21c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.193038:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a21c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.193272:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a21c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.193280:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a21c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.193286:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241302.193291:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a21c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.193298:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a21c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.193310:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241302.193313:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782241302.193317:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a21c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.193322:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a21c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241302.193415:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+41:12238:x1868815120020096:12345-192.168.204.58@tcp:54:lfs.0 Request processed in 522us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241302.193433:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 166 00000100:00100000:0.0:1782241302.203198:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241302.203511:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120020352 00000100:00100000:3.0:1782241302.203520:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120020352 00000100:00100000:3.0:1782241302.203578:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 41 00000100:00100000:3.0:1782241302.203588:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+41:12238:x1868815120020352:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:3.0:1782241302.203893:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+42:12238:x1868815120020352:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 305us (703us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1782241302.203902:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 41 00000100:00100000:2.0:1782241302.277093:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140008960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241302.277183:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241302.277284:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140009088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241302.277311:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241302.277336:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140008960 00000100:00100000:0.0:1782241302.277346:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140008960 00000100:00100000:0.0:1782241302.277414:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1782241302.277423:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140008960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241302.277458:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782241302.277528:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140008960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241302.277535:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1782241302.277578:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140008960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241302.277683:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140009088 00000100:00100000:1.0:1782241302.277688:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140009088 00000100:00100000:1.0:1782241302.277728:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782241302.277736:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140009088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782241302.277753:0:14428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782241302.277816:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140009088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241302.277824:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782241302.277855:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48203800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140009088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241302.613550:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241302.614068:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120020608 00000100:00100000:1.0:1782241302.614082:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120020608 00000100:00100000:1.0:1782241302.614241:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 167 00000100:00100000:1.0:1782241302.614255:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+42:12270:x1868815120020608:12345-192.168.204.58@tcp:101:cat.0 00010000:00010000:1.0:1782241302.614290:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241302.614317:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a223 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350534f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.614478:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a22a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.614499:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a22a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.614513:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a22a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241302.614548:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782241302.614713:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a223 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350534f expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.614738:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a22a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350534f expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.614747:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241302.614750:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241302.615087:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb800, rc 0) 00000100:00100000:1.0:1782241302.615196:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+44:12270:x1868815120020608:12345-192.168.204.58@tcp:101:cat.0 Request processed in 943us (1661us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1782241302.615207:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 167 00000100:00100000:2.0:1782241302.623067:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241302.623478:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120020864 00000100:00100000:0.0:1782241302.623493:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120020864 00000100:00100000:0.0:1782241302.623564:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 42 00000100:00100000:0.0:1782241302.623576:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+44:12270:x1868815120020864:12345-192.168.204.58@tcp:35:cat.0 00000100:00100000:0.0:1782241302.624598:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+45:12270:x1868815120020864:12345-192.168.204.58@tcp:35:cat.0 Request processed in 1006us (1529us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1782241302.624610:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 42 00000100:00100000:2.0:1782241302.626311:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241302.627123:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120020992 00000100:00100000:1.0:1782241302.627133:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120020992 00000100:00100000:1.0:1782241302.627205:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 14 00000100:00100000:1.0:1782241302.627215:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+45:2399:x1868815120020992:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241302.627230:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241302.627257:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a22a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350534f expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.627276:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241302.627281:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241302.627333:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+44:2399:x1868815120020992:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 120us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241302.627341:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 14 00000100:00100000:2.0:1782241302.711343:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241302.711626:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120021248 00000100:00100000:3.0:1782241302.711635:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120021248 00000100:00100000:3.0:1782241302.711699:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 168 00000100:00100000:3.0:1782241302.711710:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+44:12276:x1868815120021248:12345-192.168.204.58@tcp:101:dd.0 00010000:00010000:3.0:1782241302.711736:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241302.711739:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782241302.711808:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a190 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505325 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241302.711829:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:3.0:1782241302.711834:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782241302.711846:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a238 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505356 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.712945:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a23f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.712966:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a20e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505348 expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.712975:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a23f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.713048:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a20e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505348 expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.713065:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a20e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505348 expref: 44 pid: 6510 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241302.713089:0:6511:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4822a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1868815140009216:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241302.713189:0:6511:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d478e9540 going to sleep for 11 seconds 00000100:00100000:2.0:1782241302.719620:0:6511:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4822a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1868815140009216:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241302.719652:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a23f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241302.725511:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241302.726890:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120021376 00000100:00100000:3.0:1782241302.726903:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120021376 00010000:00010000:2.0:1782241302.727131:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a20e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505348 expref: 45 pid: 6510 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241302.727217:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 82 00000100:00100000:2.0:1782241302.727229:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e436c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+45:2399:x1868815120021376:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241302.727243:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241302.727251:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a20e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505348 expref: 45 pid: 6510 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.727263:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a20e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505348 expref: 45 pid: 6510 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.727285:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a20e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505348 expref: 45 pid: 6510 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.727303:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241302.727308:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a23f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.727317:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a23f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.727344:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a23f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241302.727378:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241302.727455:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e436c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+44:2399:x1868815120021376:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 228us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241302.727463:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 82 00010000:00010000:0.0:1782241302.727553:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a23f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241302.727562:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a23f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241302.727599:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1782241302.727746:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a238 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505356 expref: 45 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241302.727783:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a23f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505356 expref: 44 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241302.727791:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241302.727794:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782241302.727796:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad400, rc 0) 00000100:00100000:0.0:1782241302.727822:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+44:12276:x1868815120021248:12345-192.168.204.58@tcp:101:dd.0 Request processed in 16114us (16487us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1782241302.727828:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 168 00000100:00100000:0.0:1782241302.733057:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241302.733207:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120021504 00000100:00100000:1.0:1782241302.733218:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120021504 00000100:00100000:1.0:1782241302.733280:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 169 00000100:00100000:1.0:1782241302.733290:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+44:12276:x1868815120021504:12345-192.168.204.58@tcp:101:dd.0 00010000:00010000:1.0:1782241302.733315:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241302.733335:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a24d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350535d expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.733373:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a254 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.733388:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a254 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.733402:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a254 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.733532:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a24d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350535d expref: 46 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.733552:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a254 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350535d expref: 45 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241302.733562:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241302.733565:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782241302.733569:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb400, rc 0) 00000100:00100000:1.0:1782241302.734271:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+45:12276:x1868815120021504:12345-192.168.204.58@tcp:101:dd.0 Request processed in 979us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241302.734282:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 169 00000100:00100000:1.0:1782241302.740173:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241302.740801:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120021760 00000100:00100000:3.0:1782241302.740811:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120021760 00000100:00100000:3.0:1782241302.740866:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 170 00000100:00100000:3.0:1782241302.740876:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+45:12276:x1868815120021760:12345-192.168.204.58@tcp:36:dd.0 00010000:00010000:3.0:1782241302.741121:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a25b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241302.741139:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a25b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241302.741151:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a25b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782241302.741191:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:3.0:1782241302.741699:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b995244b reply state 0000000051d1d197 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a25b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241302.741714:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a25b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241302.741722:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:3.0:1782241302.741725:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782241302.741728:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782241302.741928:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+48:12276:x1868815120021760:12345-192.168.204.58@tcp:36:dd.0 Request processed in 1052us (1894us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1782241302.741937:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 170 00000020:00080000:3.0:1782241302.741943:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782241303.116571:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241303.116750:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120021888 00000100:00100000:0.0:1782241303.116815:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120021888 00000100:00100000:0.0:1782241303.116902:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 171 00000100:00100000:0.0:1782241303.116914:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4822a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+48:12290:x1868815120021888:12345-192.168.204.58@tcp:101:stat.0 00010000:00010000:0.0:1782241303.116942:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241303.116965:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a262 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505364 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.117033:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e1a269 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.117049:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e1a269 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.117084:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e1a269 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.117120:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a270 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.117128:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a270 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.117134:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a270 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.117223:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a277 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.117236:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a23f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505356 expref: 49 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.117246:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a277 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.117282:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a23f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505356 expref: 49 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.117295:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a23f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505356 expref: 49 pid: 6511 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241303.117309:0:6511:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48200a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1868815140009344:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241303.117401:0:6511:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afd540 going to sleep for 11 seconds 00000100:00080000:2.0:1782241303.117478:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241303.122564:0:6511:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48200a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1868815140009344:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241303.122607:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a277 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241303.124621:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241303.124729:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120022144 00000100:00100000:0.0:1782241303.124738:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120022144 00000100:00100000:0.0:1782241303.124819:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 43 00000100:00100000:0.0:1782241303.124829:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+50:6166:x1868815120022144:12345-192.168.204.58@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782241303.125341:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+51:6166:x1868815120022144:12345-192.168.204.58@tcp:35:ldlm_bl.0 Request processed in 511us (727us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1782241303.125351:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 43 00000100:00100000:0.0:1782241303.131890:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241303.132385:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120022272 00000100:00100000:1.0:1782241303.132395:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120022272 00010000:00010000:1.0:1782241303.132436:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a23f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505356 expref: 51 pid: 6511 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241303.132792:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 83 00000100:00100000:0.0:1782241303.132805:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+51:2396:x1868815120022272:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241303.132821:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241303.132829:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a23f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505356 expref: 51 pid: 6511 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.132843:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a23f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505356 expref: 51 pid: 6511 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.132867:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a23f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505356 expref: 51 pid: 6511 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.132884:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241303.132889:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a277 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.132899:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a277 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.132906:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a277 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.133086:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241303.133152:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+50:2396:x1868815120022272:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 349us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241303.133160:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 83 00010000:00010000:2.0:1782241303.135865:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a277 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.135884:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a277 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241303.136026:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1782241303.136031:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782241303.136054:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a277 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136070:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a277 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136081:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e1a269 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136111:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e1a269 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136119:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e1a269 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136125:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241303.136129:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e1a269 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136137:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e1a269 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136152:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:2.0:1782241303.136155:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241303.136160:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e1a269 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136166:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1800/0xc9959f2fb1e1a269 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136183:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a270 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136189:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a270 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136196:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a270 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136201:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241303.136211:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a270 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136218:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a270 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136227:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890d4195b600) 00010000:00010000:2.0:1782241303.136230:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241303.136233:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a270 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136239:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a270 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136278:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a262 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505364 expref: 50 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136292:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a277 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505364 expref: 49 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.136300:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241303.136303:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241303.136305:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1a00, rc 0) 00000100:00100000:2.0:1782241303.136447:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4822a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+49:12290:x1868815120021888:12345-192.168.204.58@tcp:101:stat.0 Request processed in 19524us (19876us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241303.136456:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 171 00010000:00010000:3.0:1782241303.173014:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241303.215470:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241303.215602:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120022528 00000100:00100000:1.0:1782241303.215613:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120022528 00000100:00100000:1.0:1782241303.215984:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 172 00000100:00100000:1.0:1782241303.215996:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+49:12296:x1868815120022528:12345-192.168.204.58@tcp:36:truncate.0 00010000:00010000:1.0:1782241303.216056:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241303.216086:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a277 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505364 expref: 49 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.216106:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241303.216110:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241303.216299:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a27e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.216314:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a27e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.216323:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a27e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782241303.216362:0:11191:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967447 00000004:00010000:1.0:1782241303.216384:0:11191:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f098f7a2 reply state 00000000092222bd transno 4294967448 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a27e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.216395:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a27e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.216416:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241303.216419:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782241303.216421:0:11191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782241303.217792:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+51:12296:x1868815120022528:12345-192.168.204.58@tcp:36:truncate.0 Request processed in 1791us (2323us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1782241303.217808:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 172 00000020:00080000:1.0:1782241303.217815:0:11191:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782241303.501249:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241303.502130:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120022656 00000100:00100000:3.0:1782241303.502143:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120022656 00000100:00100000:3.0:1782241303.502220:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 173 00000100:00100000:3.0:1782241303.502233:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+51:12310:x1868815120022656:12345-192.168.204.58@tcp:101:stat.0 00010000:00010000:3.0:1782241303.502265:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241303.502294:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a285 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350536b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.502376:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a28c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.502391:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a28c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.502402:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a28c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.502414:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a293 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.502420:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.502426:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.502508:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a29a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.502517:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a29a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.502546:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a29a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241303.502606:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1782241303.502611:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782241303.502636:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a29a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.502649:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a29a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.502658:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a28c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.502664:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a28c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.502671:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a28c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.502677:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241303.502682:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a28c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.502688:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a28c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.504103:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:3.0:1782241303.504112:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241303.504119:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a28c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.504145:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a28c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.504164:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.504170:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a293 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.504176:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a293 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.504181:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241303.504185:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a293 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.504192:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a293 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.504203:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890d4195b600) 00010000:00010000:3.0:1782241303.504205:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241303.504208:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a293 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.504213:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a293 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.504257:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a285 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350536b expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.504271:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a29a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350536b expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.504286:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:3.0:1782241303.504288:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782241303.504291:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164da00, rc 0) 00000100:00100000:3.0:1782241303.504453:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+52:12310:x1868815120022656:12345-192.168.204.58@tcp:101:stat.0 Request processed in 2220us (3211us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241303.504462:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 173 00000100:00100000:2.0:1782241303.630614:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241303.630874:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120022912 00000100:00100000:0.0:1782241303.630886:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120022912 00000100:00100000:0.0:1782241303.630951:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 174 00000100:00100000:0.0:1782241303.630963:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+52:12320:x1868815120022912:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241303.630984:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241303.631014:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e1a2a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505372 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241303.631140:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1782241303.631246:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e1a2a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505372 expref: 54 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.631262:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b100) 00010000:00010000:0.0:1782241303.631265:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782241303.631273:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e1a2a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505372 expref: 54 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.631287:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1e00, rc 0) 00000100:00100000:0.0:1782241303.631353:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+53:12320:x1868815120022912:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 393us (752us total) trans 4294967449 rc 301/301 00000100:00100000:0.0:1782241303.631360:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 174 00000100:00100000:1.0:1782241303.636391:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241303.636475:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120023168 00000100:00100000:3.0:1782241303.636484:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120023168 00000100:00100000:3.0:1782241303.636645:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 44 00000100:00100000:3.0:1782241303.638711:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47a4a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+53:12320:x1868815120023168:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:3.0:1782241303.639490:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47a4a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+54:12320:x1868815120023168:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 2832us (3105us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1782241303.639500:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 44 00000100:00100000:2.0:1782241303.766218:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241303.766442:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120023424 00000100:00100000:1.0:1782241303.766454:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120023424 00000100:00100000:1.0:1782241303.766519:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 175 00000100:00100000:1.0:1782241303.766530:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4822b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+54:12326:x1868815120023424:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:1.0:1782241303.766578:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241303.766600:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a2af lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505379 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.766711:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a2b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.766728:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a29a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350536b expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.766738:0:11191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a2b6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.766814:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a29a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350536b expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.766847:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a29a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350536b expref: 55 pid: 6512 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241303.766861:0:11191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48356a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11191:1868815140009472:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241303.766969:0:11191:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48527f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782241303.770836:0:11191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48356a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11191:1868815140009472:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241303.770865:0:11191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a2b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241303.774399:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241303.774492:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120023552 00000100:00100000:0.0:1782241303.774501:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120023552 00010000:00010000:0.0:1782241303.774551:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a29a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350536b expref: 56 pid: 6512 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241303.774599:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 84 00000100:00100000:0.0:1782241303.774610:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4822b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+56:2399:x1868815120023552:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241303.774626:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241303.774632:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a29a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350536b expref: 56 pid: 6512 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.774645:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a29a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350536b expref: 56 pid: 6512 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.774678:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a29a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350536b expref: 56 pid: 6512 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.774694:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241303.774700:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a2b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.774709:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a2b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.774716:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a2b6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.774748:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241303.774854:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4822b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+55:2399:x1868815120023552:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 245us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241303.774875:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 84 00010000:00010000:1.0:1782241303.775170:0:11191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a2b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.775179:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a2b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241303.775198:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1782241303.775335:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a2af lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505379 expref: 56 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.775351:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a2b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505379 expref: 55 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.775359:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241303.775361:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782241303.775364:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eae00, rc 0) 00000100:00100000:1.0:1782241303.775408:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4822b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+55:12326:x1868815120023424:12345-192.168.204.58@tcp:101:bash.0 Request processed in 8880us (9199us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1782241303.775423:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 175 00000100:00100000:2.0:1782241303.781503:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241303.783441:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120023808 00000100:00100000:3.0:1782241303.783455:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120023808 00000100:00100000:3.0:1782241303.783515:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 176 00000100:00100000:3.0:1782241303.783524:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+55:12326:x1868815120023808:12345-192.168.204.58@tcp:36:bash.0 00010000:00010000:3.0:1782241303.783823:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a2c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.783840:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.783851:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782241303.783910:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967452 00000004:00010000:3.0:1782241303.783938:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ed6abcf0 reply state 000000008ff714db transno 4294967453 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.783951:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a2c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241303.783958:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:3.0:1782241303.783961:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782241303.783964:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782241303.784072:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+58:12326:x1868815120023808:12345-192.168.204.58@tcp:36:bash.0 Request processed in 547us (2577us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1782241303.784079:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 176 00000020:00080000:3.0:1782241303.784085:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1782241303.796006:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241303.796111:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120023936 00000100:00100000:1.0:1782241303.796121:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120023936 00000100:00100000:1.0:1782241303.796189:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 177 00000100:00100000:1.0:1782241303.796200:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+58:12326:x1868815120023936:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:1.0:1782241303.796223:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241303.796243:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a2cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505380 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.796332:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a2d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.796354:0:10147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a2b6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505379 expref: 59 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.796373:0:10147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a2d2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.796414:0:10147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a2b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505379 expref: 59 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.796427:0:10147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a2b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505379 expref: 59 pid: 11191 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241303.796440:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48356a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140009600:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241303.796531:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48527f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782241303.805662:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241303.805810:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48356a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140009600:192.168.204.58@tcp:104: 00010000:00010000:0.0:1782241303.805837:0:10147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a2d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241303.806024:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120024064 00000100:00100000:2.0:1782241303.806032:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120024064 00010000:00010000:2.0:1782241303.806067:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a2b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505379 expref: 60 pid: 11191 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241303.806116:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 85 00000100:00100000:2.0:1782241303.806125:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:2398:x1868815120024064:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241303.806141:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241303.806148:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a2b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505379 expref: 60 pid: 11191 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.806160:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a2b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505379 expref: 60 pid: 11191 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.806181:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a2b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505379 expref: 60 pid: 11191 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.806196:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241303.806201:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a2d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.806211:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.806219:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a2d2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241303.806247:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782241303.806377:0:10147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.806384:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241303.806436:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1782241303.806440:0:10147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241303.806460:0:10147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.806490:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a2cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505380 expref: 60 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.806503:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505380 expref: 59 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.806510:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241303.806513:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782241303.806515:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea600, rc 0) 00000100:00100000:2.0:1782241303.806725:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:2398:x1868815120024064:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 600us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241303.806740:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 85 00000100:00100000:0.0:1782241303.807490:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+58:12326:x1868815120023936:12345-192.168.204.58@tcp:101:bash.0 Request processed in 11288us (11500us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241303.807511:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 177 00000100:00100000:3.0:1782241303.812485:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241303.812544:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120024320 00000100:00100000:0.0:1782241303.812555:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120024320 00000100:00100000:0.0:1782241303.812624:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 45 00000100:00100000:0.0:1782241303.812634:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+58:12326:x1868815120024320:12345-192.168.204.58@tcp:35:bash.0 00000004:00080000:1.0:1782241303.813352:0:8745:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367071594629ns, next at 368071591940ns, rc = 0 00000100:00100000:1.0:1782241303.813370:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241303.813386:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140009728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782241303.813429:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241303.813457:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140009728 00000100:00100000:1.0:1782241303.813461:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140009728 00000100:00100000:1.0:1782241303.813495:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1782241303.813502:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815140009728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782241303.813523:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782241303.813553:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815140009728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241303.813560:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1782241303.813592:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241303.813626:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140009728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782241303.813784:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:12326:x1868815120024320:12345-192.168.204.58@tcp:35:bash.0 Request processed in 1150us (1306us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1782241303.813792:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 45 00000100:00100000:0.0:1782241303.817401:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241303.817433:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140009856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241303.817507:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241303.817639:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140009856 00000100:00100000:2.0:1782241303.817647:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140009856 00000100:00100000:2.0:1782241303.817722:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782241303.817731:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140009856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782241303.817785:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782241303.817845:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140009856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241303.817852:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1782241303.818082:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241303.818123:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140009856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241303.930948:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241303.931055:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120024576 00000100:00100000:1.0:1782241303.931064:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120024576 00000100:00100000:1.0:1782241303.931122:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 178 00000100:00100000:1.0:1782241303.931132:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:12336:x1868815120024576:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241303.931156:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241303.931176:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a2d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505387 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241303.931279:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1782241303.931382:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a2d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505387 expref: 61 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.931394:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b100) 00010000:00010000:1.0:1782241303.931410:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782241303.931417:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a2d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505387 expref: 61 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241303.931430:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ebc00, rc 0) 00000100:00100000:1.0:1782241303.931497:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:12336:x1868815120024576:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 367us (558us total) trans 4294967455 rc 301/301 00000100:00100000:1.0:1782241303.931505:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 178 00000100:00100000:3.0:1782241303.936089:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241303.936186:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120024704 00000100:00100000:0.0:1782241303.936197:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120024704 00000100:00100000:0.0:1782241303.936263:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 179 00000100:00100000:0.0:1782241303.936273:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:12336:x1868815120024704:12345-192.168.204.58@tcp:34:lfs.0 00010000:00010000:0.0:1782241303.936351:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a2e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936368:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a2e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936380:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a2e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936390:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a2ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936419:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a2ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936427:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a2ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936499:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a2f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936508:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936515:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782241303.936574:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936588:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a2e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936595:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a2e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936603:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a2e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936609:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241303.936613:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a2e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936623:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a2e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936642:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:0.0:1782241303.936644:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241303.936649:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a2e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936655:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a2e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936671:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a2ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936676:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a2ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936682:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a2ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936688:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241303.936691:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a2ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936697:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a2ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936704:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890d4195b600) 00010000:00010000:0.0:1782241303.936706:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241303.936721:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a2ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936727:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a2ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936749:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936804:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a2f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936810:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936815:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241303.936818:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936825:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a2f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936833:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241303.936836:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241303.936839:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a2f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241303.936845:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a2f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241303.936916:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:12336:x1868815120024704:12345-192.168.204.58@tcp:34:lfs.0 Request processed in 644us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241303.936923:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 179 00000100:00100000:0.0:1782241303.942300:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241303.942416:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120024960 00000100:00100000:1.0:1782241303.942426:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120024960 00000100:00100000:1.0:1782241303.942483:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 46 00000100:00100000:1.0:1782241303.942492:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:12336:x1868815120024960:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:1.0:1782241303.942733:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+61:12336:x1868815120024960:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 241us (442us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1782241303.942742:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 46 00000100:00100000:3.0:1782241304.045503:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241304.045667:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120025216 00000100:00100000:0.0:1782241304.045677:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120025216 00000100:00100000:0.0:1782241304.045841:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 180 00000100:00100000:0.0:1782241304.045852:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+61:12339:x1868815120025216:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241304.045877:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241304.045896:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a2fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350538e expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.045969:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a303 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.045995:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a303 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.046006:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a303 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.046595:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a30a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.046608:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a30a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.046616:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a30a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.046743:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a311 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.046753:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a311 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.046791:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a311 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241304.046816:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782241304.046915:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a303 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.046923:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a303 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.046930:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a303 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.046936:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241304.046940:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a303 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.046947:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a303 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.046959:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:0.0:1782241304.046963:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241304.046967:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a303 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.046973:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a303 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.047205:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a30a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.047212:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a30a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.047228:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a30a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.047234:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241304.047236:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a30a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.047243:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a30a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.047928:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890d4195b600) 00010000:00010000:0.0:1782241304.047931:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241304.047936:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a30a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.047943:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0800/0xc9959f2fb1e1a30a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.048224:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a2fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350538e expref: 64 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.048241:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a311 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350538e expref: 63 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.048249:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241304.048251:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782241304.048254:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1600, rc 0) 00000100:00100000:0.0:1782241304.048635:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:12339:x1868815120025216:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 2783us (3140us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1782241304.048652:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 180 00000001:00080000:2.0:1782241304.050151:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:2.0:1782241304.050170:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1782241304.050214:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1782241304.050223:0:6489:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff890e47afdd80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1782241304.050227:0:6489:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e7788c900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff890e47afd240 00000020:00080000:2.0:1782241304.050230:0:6489:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e7788cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff890d47abaa00 00000020:00080000:2.0:1782241304.050353:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1782241304.050408:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1782241304.050431:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241304.050448:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140009984:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782241304.050517:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241304.050620:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a112 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050631:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a112 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050638:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a112 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050655:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43face00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241304.050661:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a112 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050670:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a112 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050688:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff890d4781cd00) 00010000:00010000:2.0:1782241304.050691:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241304.050696:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a112 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050703:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a112 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050722:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a119 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050729:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a119 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050735:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a119 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050740:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fadc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241304.050743:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a119 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050749:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a119 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050791:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:2.0:1782241304.050793:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241304.050797:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a119 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050803:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a119 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050818:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a158 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050824:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a158 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050830:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a158 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050835:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241304.050837:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a158 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050843:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a158 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050851:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890d4195b600) 00010000:00010000:2.0:1782241304.050853:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241304.050856:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a158 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050862:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a158 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050892:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a25b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050899:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a25b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050905:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a25b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050910:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241304.050913:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a25b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050920:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a25b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050928:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241304.050931:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241304.050934:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a25b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050941:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a25b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050952:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a27e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050958:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a27e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050963:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a27e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050974:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ebe00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241304.050978:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a27e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050984:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a27e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.050993:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241304.050995:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241304.050998:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a27e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051003:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a27e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051027:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a2c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051033:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a2c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051039:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a2c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051044:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241304.051047:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a2c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051053:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a2c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051071:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241304.051073:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241304.051076:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a2c4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051081:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a2c4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241304.051115:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140009984 00000100:00100000:2.0:1782241304.051122:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140009984 00000100:00100000:2.0:1782241304.051165:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782241304.051174:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4822ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815140009984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782241304.051201:0:8747:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1782241304.051232:0:8747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a3ad816, atime: 0x6a3ad816, ctime: 0x6a3ad816, blocks: 0x8 00010000:00010000:2.0:1782241304.051240:0:8747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000663aba58/0xc9959f2fb1e1a31f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051252:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=367s v=(0 0) 00010000:00010000:2.0:1782241304.051256:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241304.051261:0:8747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000663aba58/0xc9959f2fb1e1a31f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051277:0:8747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000663aba58/0xc9959f2fb1e1a31f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051285:0:8747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000663aba58/0xc9959f2fb1e1a31f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051300:0:8747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000663aba58/0xc9959f2fb1e1a31f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051316:0:8747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782241304.051444:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4822ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3637:x1868815140009984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 270us (927us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1782241304.051451:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:2.0:1782241304.051472:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241304.051477:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000663aba58/0xc9959f2fb1e1a31f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051485:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241304.051489:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000663aba58/0xc9959f2fb1e1a31f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051496:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000663aba58/0xc9959f2fb1e1a31f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051508:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000663aba58/0xc9959f2fb1e1a31f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051515:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000663aba58/0xc9959f2fb1e1a31f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.051529:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241304.051536:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241304.051537:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782241304.051581:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890d48229c00/2, rc 0, transno 4294967308 00000100:00100000:2.0:1782241304.051588:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140009984:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782241304.059478:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241304.059605:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120025344 00000100:00100000:1.0:1782241304.059615:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120025344 00000100:00100000:1.0:1782241304.059673:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 181 00000100:00100000:1.0:1782241304.059684:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:12339:x1868815120025344:12345-192.168.204.58@tcp:54:lfs.0 00010000:00010000:1.0:1782241304.059973:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a326 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.060000:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a326 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.060010:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a326 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.060070:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a326 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.060077:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a326 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.060083:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a326 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.060090:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ebc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241304.060094:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a326 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.060101:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a326 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.060114:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241304.060118:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782241304.060122:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a326 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.060129:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a326 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241304.060199:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:12339:x1868815120025344:12345-192.168.204.58@tcp:54:lfs.0 Request processed in 516us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241304.060207:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 181 00000100:00100000:3.0:1782241304.070429:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241304.070529:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120025472 00000100:00100000:0.0:1782241304.070540:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120025472 00000100:00100000:0.0:1782241304.070616:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00100000:0.0:1782241304.070626:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:2399:x1868815120025472:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241304.070641:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241304.070664:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a311 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350538e expref: 18 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.070682:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241304.070687:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241304.070753:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+17:2399:x1868815120025472:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 119us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241304.070798:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00100000:3.0:1782241304.080636:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241304.081888:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120025728 00000100:00100000:1.0:1782241304.081899:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120025728 00000100:00100000:1.0:1782241304.082002:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 47 00000100:00100000:1.0:1782241304.082027:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+17:12339:x1868815120025728:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:1.0:1782241304.082264:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:12339:x1868815120025728:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 238us (1637us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1782241304.082273:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 47 00010000:00010000:0.0:1782241304.199694:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241304.374541:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241304.374665:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120025984 00000100:00100000:1.0:1782241304.374675:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120025984 00000100:00100000:1.0:1782241304.374751:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 182 00000100:00100000:1.0:1782241304.374798:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:12357:x1868815120025984:12345-192.168.204.58@tcp:101:cat.0 00010000:00010000:1.0:1782241304.374824:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241304.374844:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a32d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505395 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.374952:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a334 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.374968:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a334 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.374989:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a334 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241304.375001:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1782241304.375107:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a32d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505395 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.375127:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a334 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505395 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.375160:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241304.375164:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782241304.375167:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eae00, rc 0) 00000100:00100000:1.0:1782241304.375232:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:12357:x1868815120025984:12345-192.168.204.58@tcp:101:cat.0 Request processed in 437us (701us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1782241304.375239:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 182 00000100:00100000:3.0:1782241304.473909:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241304.474277:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120026112 00000100:00100000:0.0:1782241304.474288:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120026112 00000100:00100000:0.0:1782241304.474353:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 183 00000100:00100000:0.0:1782241304.474364:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:12358:x1868815120026112:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241304.474400:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241304.474421:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a342 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350539c expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.474491:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a349 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.474506:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.474532:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241304.474596:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1782241304.474600:0:10147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241304.474620:0:10147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.474646:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a342 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350539c expref: 22 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.474665:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a349 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350539c expref: 21 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241304.474673:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:0.0:1782241304.474676:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782241304.474679:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0200, rc 0) 00000100:00100000:0.0:1782241304.475022:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:12358:x1868815120026112:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 658us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241304.475028:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 183 00000100:00100000:3.0:1782241304.488804:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241304.488900:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120026496 00000100:00100000:0.0:1782241304.488911:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120026496 00000100:00100000:0.0:1782241304.488978:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 48 00000100:00100000:0.0:1782241304.488988:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:12358:x1868815120026496:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:0.0:1782241304.489311:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:12358:x1868815120026496:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 322us (555us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1782241304.489318:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 48 00000100:00100000:3.0:1782241304.492730:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241304.492862:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120026624 00000100:00100000:1.0:1782241304.492873:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120026624 00000100:00100000:1.0:1782241304.492939:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 16 00000100:00100000:1.0:1782241304.492950:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48252d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:12358:x1868815120026624:12345-192.168.204.58@tcp:103:lfs.0 00010000:00010000:1.0:1782241304.492967:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782241304.492994:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a2d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505380 expref: 22 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.493015:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a334 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505395 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.493028:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a1cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350533a expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.493039:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241304.493043:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241304.493103:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48252d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:12358:x1868815120026624:12345-192.168.204.58@tcp:103:lfs.0 Request processed in 154us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241304.493110:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 16 00000100:00100000:3.0:1782241304.497338:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241304.497481:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120026752 00000100:00100000:1.0:1782241304.497491:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120026752 00000100:00100000:1.0:1782241304.497567:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 184 00000100:00100000:1.0:1782241304.497577:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:12358:x1868815120026752:12345-192.168.204.58@tcp:58:lfs.0 00010000:00010000:1.0:1782241304.497707:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a350 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.497724:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a350 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241304.497749:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a350 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782241304.497887:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1782241304.497960:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:12358:x1868815120026752:12345-192.168.204.58@tcp:58:lfs.0 Request processed in 383us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241304.497968:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 184 00000100:00100000:0.0:1782241304.563243:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241304.563354:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120026880 00000100:00100000:2.0:1782241304.563364:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120026880 00000100:00100000:2.0:1782241304.563434:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 185 00000100:00100000:2.0:1782241304.563445:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:12360:x1868815120026880:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241304.563466:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241304.563484:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e1a357 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335053a3 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563545:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a35e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563571:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a35e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563582:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a35e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563595:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a365 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563601:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563607:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563671:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a36c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563693:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a36c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563700:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a36c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241304.563894:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1782241304.563899:0:11191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782241304.563917:0:11191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a36c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563928:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a36c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563937:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a35e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563943:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a35e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563949:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a35e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563954:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fadc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241304.563958:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a35e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563964:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a35e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563975:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:2.0:1782241304.563983:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241304.563987:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a35e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.563993:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a35e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.564005:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a365 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.564010:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a365 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.564016:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a365 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.564147:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43face00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241304.564151:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a365 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.564158:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a365 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.564166:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890e4bb38600) 00010000:00010000:2.0:1782241304.564169:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241304.564172:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a365 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.564178:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a365 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.564207:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e1a357 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053a3 expref: 21 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.564230:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a36c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053a3 expref: 20 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241304.564237:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241304.564240:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782241304.564242:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fac200, rc 0) 00000100:00100000:2.0:1782241304.564385:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:12360:x1868815120026880:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 941us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241304.564393:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 185 00000100:00100000:2.0:1782241304.999019:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241304.999070:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241304.999086:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241304.999117:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241304.999133:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241304.999149:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241304.999169:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241304.999193:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120027136 00000100:00100000:2.0:1782241304.999201:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120027136 00000100:00100000:2.0:1782241304.999243:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120027648 00000100:00100000:2.0:1782241304.999245:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120027648 00000100:00100000:2.0:1782241304.999262:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120027264 00000100:00100000:2.0:1782241304.999264:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120027264 00000100:00100000:2.0:1782241304.999274:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120027776 00000100:00100000:2.0:1782241304.999276:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120027776 00000100:00100000:2.0:1782241304.999292:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 315 00000100:00100000:2.0:1782241304.999300:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4822b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:2397:x1868815120027136:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241304.999364:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4822b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:2397:x1868815120027136:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 65us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241304.999394:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 315 00000100:00100000:2.0:1782241304.999412:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 316 00000100:00100000:2.0:1782241304.999417:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2397:x1868815120027648:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241304.999440:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2397:x1868815120027648:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 23us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241304.999446:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 316 00000100:00100000:2.0:1782241304.999456:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 317 00000100:00100000:2.0:1782241304.999461:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4822bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815120027264:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241304.999479:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4822bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815120027264:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 18us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241304.999485:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 317 00000100:00100000:2.0:1782241304.999493:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 318 00000100:00100000:2.0:1782241304.999498:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2397:x1868815120027776:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241304.999514:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2397:x1868815120027776:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 16us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241304.999520:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 318 00000100:00100000:2.0:1782241304.999535:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120027392 00000100:00100000:2.0:1782241304.999550:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120027392 00000100:00100000:2.0:1782241304.999575:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120027520 00000100:00100000:2.0:1782241304.999577:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120027520 00000100:00100000:2.0:1782241304.999593:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 132 00000100:00100000:2.0:1782241304.999599:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4822a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2397:x1868815120027392:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241304.999621:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4822a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2397:x1868815120027392:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 22us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241304.999632:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 132 00000100:00100000:2.0:1782241304.999642:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 133 00000100:00100000:2.0:1782241304.999647:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4822aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2397:x1868815120027520:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241304.999666:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4822aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2397:x1868815120027520:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 19us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241304.999671:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 133 00000100:00080000:2.0:1782241304.999691:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782241304.999694:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782241304.999697:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241304.999699:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782241305.006687:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120027008 00000100:00100000:3.0:1782241305.006702:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120027008 00000100:00100000:3.0:1782241305.006823:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 388 00000100:00100000:3.0:1782241305.006833:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2397:x1868815120027008:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241305.006914:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2397:x1868815120027008:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 83us (7795us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241305.006922:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 388 00010000:00010000:1.0:1782241305.234688:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782241305.348923:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782241305.348931:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782241305.348985:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1782241305.348993:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782241305.349123:0:13782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48229880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1868815140010112:192.168.204.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782241305.349234:0:13782:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e412ed000 going to sleep for 11 seconds 00000100:00100000:0.0:1782241305.355386:0:13782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48229880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1868815140010112:192.168.204.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782241305.356828:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241305.358248:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120027904 00000100:00100000:2.0:1782241305.358260:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120027904 00000100:00100000:2.0:1782241305.358405:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 186 00000100:00100000:2.0:1782241305.358417:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:12371:x1868815120027904:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782241305.358448:0:6510:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782241305.358575:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48203800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:12371:x1868815120027904:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 Request processed in 160us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241305.358584:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 186 00000100:00080000:0.0:1782241305.359185:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241305.362875:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241305.363208:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120028032 00000100:00100000:0.0:1782241305.363217:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120028032 00000100:00100000:0.0:1782241305.363266:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 187 00000100:00100000:0.0:1782241305.363272:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:12371:x1868815120028032:12345-192.168.204.58@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782241305.363331:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a373 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363344:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a373 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363352:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a373 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363404:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a37a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363409:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a37a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363413:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a37a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363432:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e1a381 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363437:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e1a381 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363450:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e1a381 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241305.363488:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1782241305.363491:0:11191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241305.363501:0:11191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e1a381 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363509:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a373 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363514:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a373 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363518:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a373 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363522:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1c00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241305.363525:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a373 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363529:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a373 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363554:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890e81fbc300) 00010000:00010000:0.0:1782241305.363561:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241305.363565:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a373 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363572:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a373 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363599:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a37a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363605:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a37a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363611:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a37a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363616:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0e00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241305.363618:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a37a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363624:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a37a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363632:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff890d4195bc00) 00010000:00010000:0.0:1782241305.363634:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241305.363637:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a37a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363642:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a37a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363655:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e1a381 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363660:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e1a381 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363665:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e1a381 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363676:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1e00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241305.363679:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e1a381 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363686:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e1a381 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363693:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241305.363695:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241305.363698:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e1a381 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.363704:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e1a381 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241305.364097:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:12371:x1868815120028032:12345-192.168.204.58@tcp:34:lhsmtool_posix.0 Request processed in 822us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241305.364107:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 187 00000100:00100000:1.0:1782241305.367584:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241305.368083:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120028288 00000100:00100000:3.0:1782241305.368096:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120028288 00000100:00100000:2.0:1782241305.368320:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 188 00000100:00100000:2.0:1782241305.368335:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:12371:x1868815120028288:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782241305.368365:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241305.368392:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a388 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335053aa expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.368551:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a38f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.368568:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a38f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.368583:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a38f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241305.368598:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782241305.368722:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a38f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.368731:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a38f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.368738:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a38f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.368744:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241305.368750:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a38f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.368782:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a38f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.368823:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:2.0:1782241305.368827:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782241305.368833:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a38f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.368841:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a38f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.368892:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a388 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053aa expref: 22 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.368904:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890e81fbc300) 00010000:00010000:2.0:1782241305.368907:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782241305.368911:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a388 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053aa expref: 22 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.368921:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad200, rc 0) 00000100:00100000:2.0:1782241305.369017:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:12371:x1868815120028288:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 685us (1448us total) trans 4294967461 rc 301/301 00000100:00100000:2.0:1782241305.369026:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 188 00000100:00100000:3.0:1782241305.371419:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241305.371547:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120028416 00000100:00100000:1.0:1782241305.371559:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120028416 00000100:00100000:0.0:1782241305.371626:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 189 00000100:00100000:0.0:1782241305.371641:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:12371:x1868815120028416:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782241305.371691:0:6510:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782241305.371926:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:12371:x1868815120028416:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 Request processed in 288us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241305.373452:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 189 00000100:00100000:3.0:1782241305.374453:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241305.374684:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120028672 00000100:00100000:1.0:1782241305.374693:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120028672 00000100:00100000:1.0:1782241305.374817:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 190 00000100:00100000:1.0:1782241305.374829:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:12371:x1868815120028672:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782241305.374855:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241305.374858:0:11191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782241305.374893:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a349 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350539c expref: 21 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.374930:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:1.0:1782241305.374934:0:11191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241305.374949:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1a39d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335053b1 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782241305.375985:0:11191:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1782241305.376210:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a3a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.376229:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.376242:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.376313:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1a39d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053b1 expref: 23 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.376331:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053b1 expref: 22 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.376340:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff890e81fbc500) 00010000:00010000:1.0:1782241305.376343:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241305.376346:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea400, rc 0) 00000100:00100000:1.0:1782241305.376432:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:12371:x1868815120028672:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 1605us (1983us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1782241305.376442:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 190 00000100:00100000:3.0:1782241305.379452:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241305.381305:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120028928 00000100:00100000:2.0:1782241305.381321:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120028928 00000100:00100000:2.0:1782241305.381735:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 191 00000100:00100000:2.0:1782241305.381749:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:12371:x1868815120028928:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782241305.381852:0:10147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241305.381888:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a3a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053b1 expref: 22 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.381923:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff890e81fbc500) 00010000:00010000:2.0:1782241305.381937:0:10147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241305.382072:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a3b2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382147:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a3b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382158:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a3b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382177:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a3b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xe7190e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382185:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a3b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe7190e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382191:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a3b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe7190e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382250:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a3b2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382258:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a3b2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382266:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a3b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382272:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241305.382277:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a3b2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382290:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a3b2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382301:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:2.0:1782241305.382304:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241305.382309:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a3b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382316:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a3b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382326:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a3b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe7190e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382332:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a3b9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe7190e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382338:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a3b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe7190e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382344:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241305.382347:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a3b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe7190e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382353:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a3b9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe7190e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382361:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xe7190e7 (ffff890e4bb38600) 00010000:00010000:2.0:1782241305.382363:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241305.382366:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a3b9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe7190e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.382383:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a3b9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe7190e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241305.382556:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:12371:x1868815120028928:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 809us (3115us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782241305.382565:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 191 00000100:00100000:3.0:1782241305.385601:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241305.385669:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120029056 00000100:00100000:0.0:1782241305.385682:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120029056 00000100:00100000:0.0:1782241305.385928:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 192 00000100:00100000:0.0:1782241305.385941:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:12371:x1868815120029056:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782241305.385982:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241305.386010:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e1a3c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335053b8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.386053:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a3c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.386070:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.386082:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.386220:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1e00/0xc9959f2fb1e1a3c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053b8 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.386361:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053b8 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.386372:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:0.0:1782241305.386376:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782241305.386379:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0e00, rc 0) 00000100:00100000:0.0:1782241305.386493:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:12371:x1868815120029056:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 555us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241305.386502:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 192 00000100:00100000:3.0:1782241305.393407:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241305.397597:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120029312 00000100:00100000:0.0:1782241305.397619:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120029312 00000100:00100000:0.0:1782241305.398799:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 193 00000100:00100000:0.0:1782241305.398818:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:12371:x1868815120029312:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782241305.398952:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a3ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.398975:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a3ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.398991:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a3ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782241305.399336:0:11191:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1782241305.399349:0:11191:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 368657591668ns, next at 369657587935ns, rc = 0 00000004:00010000:0.0:1782241305.399417:0:11191:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003df41470 reply state 00000000d423d033 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a3ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.399431:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a3ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.399439:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:0.0:1782241305.399442:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1782241305.399447:0:11191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782241305.400414:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+24:12371:x1868815120029312:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 1595us (7014us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1782241305.400425:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 193 00000100:00100000:0.0:1782241305.409752:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241305.411235:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120029440 00000100:00100000:0.0:1782241305.411250:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120029440 00000100:00100000:0.0:1782241305.413151:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 194 00000100:00100000:0.0:1782241305.413279:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48202680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+24:12371:x1868815120029440:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782241305.413504:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241305.413554:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a3d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335053bf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.413637:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a3d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053bf expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.413655:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a3d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053bf expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.413677:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:0.0:1782241305.413681:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782241305.413686:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1a00, rc 0) 00000100:00100000:0.0:1782241305.413795:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48202680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+25:12371:x1868815120029440:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 530us (4058us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241305.413804:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 194 00000100:00100000:3.0:1782241305.421214:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241305.421354:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120029568 00000100:00100000:2.0:1782241305.421365:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120029568 00000100:00100000:2.0:1782241305.421423:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 59 00000100:00100000:2.0:1782241305.421435:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815120029568:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1782241305.421938:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2399:x1868815120029568:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 Request processed in 503us (736us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1782241305.421949:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 59 00000100:00100000:3.0:1782241305.426211:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241305.426353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120029824 00000100:00100000:1.0:1782241305.426366:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120029824 00000100:00100000:1.0:1782241305.426438:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 49 00000100:00100000:1.0:1782241305.426450:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+25:12371:x1868815120029824:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782241305.426789:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+26:12371:x1868815120029824:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 311us (559us total) trans 4294967464 rc 0/0 00000100:00100000:1.0:1782241305.426798:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 49 00000100:00100000:2.0:1782241305.434475:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241305.434573:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120030080 00000100:00100000:1.0:1782241305.434589:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120030080 00000100:00100000:1.0:1782241305.434677:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 195 00000100:00100000:1.0:1782241305.434689:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+26:12371:x1868815120030080:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782241305.434891:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+26:12371:x1868815120030080:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 202us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241305.434900:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 195 00000100:00100000:3.0:1782241305.440334:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241305.446166:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120030208 00000100:00100000:2.0:1782241305.446186:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120030208 00000100:00100000:3.0:1782241305.446378:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 196 00000100:00100000:3.0:1782241305.446393:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+26:12371:x1868815120030208:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782241305.446423:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241305.446452:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a3dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335053c6 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.446566:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a3e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.446585:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.446601:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241305.446676:0:11191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782241305.446701:0:11191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.446745:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a3dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053c6 expref: 28 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.446811:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053c6 expref: 27 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.446821:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:3.0:1782241305.446825:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782241305.446829:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c400, rc 0) 00000100:00100000:3.0:1782241305.446923:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:12371:x1868815120030208:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 533us (6604us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241305.446933:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 196 00000100:00100000:1.0:1782241305.459631:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241305.459786:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120030336 00000100:00100000:2.0:1782241305.459799:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120030336 00000100:00100000:2.0:1782241305.459880:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 60 00000100:00100000:2.0:1782241305.459893:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2398:x1868815120030336:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782241305.459919:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241305.459946:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a3ea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335053cd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782241305.459979:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3ad819, blocks: 0x0 00010000:00010000:2.0:1782241305.460004:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=368s v=(0 0) 00010000:00010000:2.0:1782241305.460025:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241305.460036:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a3ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053cd expref: 8 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.460059:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a3ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053cd expref: 8 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.460076:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad600, rc 0) 00000100:00100000:2.0:1782241305.460153:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2398:x1868815120030336:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 262us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241305.460163:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 60 00000100:00100000:3.0:1782241305.463811:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241305.463986:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120030592 00000100:00100000:2.0:1782241305.464000:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120030592 00000100:00100000:2.0:1782241305.464082:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 197 00000100:00100000:2.0:1782241305.464094:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:12371:x1868815120030592:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782241305.464265:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:12371:x1868815120030592:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 173us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241305.464275:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 197 00000100:00100000:1.0:1782241305.476075:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241305.476231:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120030720 00000100:00100000:3.0:1782241305.476244:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120030720 00000100:00100000:3.0:1782241305.476321:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 61 00000100:00100000:3.0:1782241305.476335:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:12371:x1868815120030720:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782241305.476361:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241305.476383:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093151005/0xc9959f2fb1e1a3f1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335053d4 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.476424:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a3ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053cd expref: 9 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.476446:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241305.476451:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241305.476457:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093151005/0xc9959f2fb1e1a3f1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053d4 expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.476500:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a3ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053cd expref: 9 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.476515:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a3ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053cd expref: 9 pid: 8423 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241305.476544:0:8425:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48819880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8425:1868815140010240:192.168.204.58@tcp:104: 00000100:00100000:3.0:1782241305.476664:0:8425:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241305.480258:0:8425:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48819880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8425:1868815140010240:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241305.480310:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093151005/0xc9959f2fb1e1a3f1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053d4 expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.480337:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d600, rc 0) 00000100:00100000:3.0:1782241305.480415:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:12371:x1868815120030720:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 4082us (4354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241305.480428:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 61 00000100:00100000:3.0:1782241305.480562:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241305.480657:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120030848 00000100:00100000:3.0:1782241305.480665:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120030848 00010000:00010000:3.0:1782241305.480708:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a3ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053cd expref: 9 pid: 8423 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241305.480751:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 86 00000100:00100000:3.0:1782241305.480777:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48819880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2399:x1868815120030848:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241305.480794:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241305.480820:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a3ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053cd expref: 9 pid: 8423 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.480834:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a3ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053cd expref: 9 pid: 8423 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.480863:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a3ea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053cd expref: 9 pid: 8423 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.480878:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241305.480883:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241305.480891:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093151005/0xc9959f2fb1e1a3f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053d4 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.480903:0:10331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093151005/0xc9959f2fb1e1a3f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053d4 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.480943:0:10331:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000093151005/0xc9959f2fb1e1a3f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053d4 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241305.480973:0:10331:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48819180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10331:1868815140010368:192.168.204.58@tcp:105: 00000100:00100000:3.0:1782241305.481039:0:10331:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241305.491087:0:10331:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48819180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10331:1868815140010368:192.168.204.58@tcp:105: 00010000:00010000:3.0:1782241305.491124:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241305.491243:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241305.491418:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120030976 00000100:00100000:0.0:1782241305.491426:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120030976 00002000:00100000:0.0:1782241305.491482:0:8430:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff890d48357100 x1868815120030976/t0(0) o4->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:396/0 lens 504/0 e 0 to 0 dl 1782241316 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782241305.491494:0:8430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d48357100 with x1868815120030976 ext(0->8) 00002000:00010000:0.0:1782241305.491500:0:8430:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff890d48357100 00000100:00100000:0.0:1782241305.491540:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 4 00000100:00100000:0.0:1782241305.491550:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2399:x1868815120030976:12345-192.168.204.58@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1782241305.492453:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:2399:x1868815120030976:12345-192.168.204.58@tcp:4:lhsmtool_posix.0 Request processed in 898us (1206us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1782241305.492466:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 4 00002000:00100000:2.0:1782241305.492475:0:8430:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff890d48357100 x1868815120030976/t4294967315(0) o4->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:396/0 lens 504/448 e 0 to 0 dl 1782241316 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782241305.492484:0:8430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d48357100 with x1868815120030976 ext(0->8) 00002000:00010000:2.0:1782241305.492488:0:8430:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff890d48357100 00000100:00100000:3.0:1782241305.493070:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48819880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+10:2399:x1868815120030848:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 12291us (12504us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241305.493082:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 86 00000100:00100000:1.0:1782241305.499859:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241305.499948:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120031104 00000100:00100000:0.0:1782241305.499961:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120031104 00000100:00100000:0.0:1782241305.500041:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 198 00000100:00100000:0.0:1782241305.500053:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:12371:x1868815120031104:12345-192.168.204.58@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1782241305.501785:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967464 is committed 00000004:00080000:0.0:1782241305.501803:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1782241305.501830:0:6489:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1782241305.501857:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1782241305.501869:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1782241305.502024:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:12371:x1868815120031104:12345-192.168.204.58@tcp:44:lhsmtool_posix.0 Request processed in 1966us (2172us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241305.502036:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 198 00010000:00010000:1.0:1782241305.502256:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a3ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.502269:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a3ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.502277:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a3ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.502284:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1c00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241305.502297:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a3ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.502306:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a3ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.502327:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:1.0:1782241305.502332:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782241305.502339:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a3ce lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.502346:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1c00/0xc9959f2fb1e1a3ce lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241305.502834:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140010496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782241305.502903:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241305.502962:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140010496 00000100:00100000:1.0:1782241305.502970:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140010496 00000100:00100000:1.0:1782241305.503026:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782241305.503035:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140010496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1782241305.503197:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1782241305.503201:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1782241305 00002000:00010000:1.0:1782241305.503204:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782241305.503206:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1782241305 -> 1782241305 00002000:00010000:1.0:1782241305.503208:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1782241305.503244:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815140010496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (342us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1782241305.503257:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1782241305.503285:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1782241305.503332:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890d48819180/2, rc 0, transno 4294967316 00000100:00100000:1.0:1782241305.503339:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140010496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782241305.505810:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241305.505946:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120031232 00000100:00100000:3.0:1782241305.505958:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120031232 00000100:00100000:3.0:1782241305.506029:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 63 00000100:00100000:3.0:1782241305.506040:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+10:2399:x1868815120031232:12345-192.168.204.58@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1782241305.508115:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1782241305.508136:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1782241305.508330:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2399:x1868815120031232:12345-192.168.204.58@tcp:16:lhsmtool_posix.0 Request processed in 2282us (2524us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241305.508345:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 63 00000100:00100000:0.0:1782241305.512472:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241305.512647:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120031488 00000100:00100000:3.0:1782241305.512660:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120031488 00000100:00100000:3.0:1782241305.512921:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 199 00000100:00100000:3.0:1782241305.512934:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:12371:x1868815120031488:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782241305.513008:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241305.513043:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a3e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053c6 expref: 19 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.513062:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:3.0:1782241305.513068:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782241305.513123:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e1a3f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.513147:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e1a3f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.513159:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e1a3f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782241305.513319:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049f40449 reply state 00000000449101f2 transno 4294967465 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e1a3f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.513333:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e1a3f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.513339:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:3.0:1782241305.513343:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782241305.513346:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782241305.513580:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:12371:x1868815120031488:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 648us (1121us total) trans 4294967465 rc 0/0 00000100:00100000:3.0:1782241305.513588:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 199 00000100:00100000:1.0:1782241305.520178:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241305.520341:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120031616 00000100:00100000:0.0:1782241305.520354:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120031616 00000100:00100000:0.0:1782241305.520418:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 64 00000100:00100000:0.0:1782241305.520430:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2399:x1868815120031616:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782241305.520645:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1782241305.520649:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1782241305 -> 1782241304 00002000:00010000:0.0:1782241305.520652:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1782241302 00002000:00010000:0.0:1782241305.520654:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1782241305 -> 1782241304 00002000:00010000:0.0:1782241305.520656:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1782241305.521000:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2399:x1868815120031616:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 Request processed in 569us (830us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1782241305.521010:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 64 00000100:00100000:1.0:1782241305.534937:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241305.535035:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120031872 00000100:00100000:0.0:1782241305.535047:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120031872 00000100:00100000:0.0:1782241305.535129:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 200 00000100:00100000:0.0:1782241305.535142:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:12371:x1868815120031872:12345-192.168.204.58@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1782241305.535233:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a3ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.535253:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a3c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053b8 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.535265:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a3ff lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.535315:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053b8 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.535331:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a3c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053b8 expref: 20 pid: 6510 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241305.535350:0:6510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7d996d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1868815140010624:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241305.535475:0:6510:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241305.539091:0:6510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7d996d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1868815140010624:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241305.539132:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a3ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241305.544539:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241305.544797:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120032000 00000100:00100000:0.0:1782241305.544810:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120032000 00010000:00010000:0.0:1782241305.544865:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a3c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053b8 expref: 21 pid: 6510 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241305.544912:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 87 00000100:00100000:0.0:1782241305.544923:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e436c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:2398:x1868815120032000:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241305.544941:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241305.544949:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a3c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053b8 expref: 21 pid: 6510 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.544983:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053b8 expref: 21 pid: 6510 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.545011:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0e00/0xc9959f2fb1e1a3c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053b8 expref: 21 pid: 6510 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.545031:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:0.0:1782241305.545037:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a3ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.545048:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a3ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.545058:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a3ff lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.545088:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241305.545265:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e436c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:2398:x1868815120032000:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 343us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241305.545273:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 87 00010000:00010000:1.0:1782241305.545331:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a3ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.545341:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a3ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.545390:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a3ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.545399:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a3ff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.545405:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a3ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.545412:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241305.545416:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a3ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.545425:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a3ff lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.545442:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:1.0:1782241305.545445:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1782241305.545450:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a3ff lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.545456:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a3ff lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241305.545513:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:12371:x1868815120031872:12345-192.168.204.58@tcp:55:lhsmtool_posix.0 Request processed in 10374us (10591us total) trans 0 rc -22/-22 00000100:00100000:1.0:1782241305.545524:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 200 00000100:00100000:1.0:1782241305.553208:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241305.553366:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120032128 00000100:00100000:2.0:1782241305.553378:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120032128 00000100:00100000:2.0:1782241305.553448:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 65 00000100:00100000:2.0:1782241305.553461:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2397:x1868815120032128:12345-192.168.204.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1782241305.553523:0:8747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a406 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.553629:0:8747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093151005/0xc9959f2fb1e1a3f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053d4 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.553639:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241305.553643:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782241305.553648:0:8747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a406 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.553693:0:8747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093151005/0xc9959f2fb1e1a3f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053d4 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.553707:0:8747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093151005/0xc9959f2fb1e1a3f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053d4 expref: 8 pid: 8425 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241305.553725:0:8747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4822b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:8747:1868815140010752:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241305.553854:0:8747:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e412ed180 going to sleep for 11 seconds 00000100:00100000:3.0:1782241305.559102:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241305.559228:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120032256 00000100:00100000:0.0:1782241305.559241:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120032256 00010000:00010000:0.0:1782241305.559291:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093151005/0xc9959f2fb1e1a3f1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053d4 expref: 9 pid: 8425 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241305.559335:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 88 00000100:00100000:2.0:1782241305.559341:0:8747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4822b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:8747:1868815140010752:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241305.559346:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48818e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2398:x1868815120032256:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241305.559372:0:8747:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a406 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.559382:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241305.559408:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093151005/0xc9959f2fb1e1a3f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053d4 expref: 9 pid: 8425 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.559422:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093151005/0xc9959f2fb1e1a3f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053d4 expref: 9 pid: 8425 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.559452:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093151005/0xc9959f2fb1e1a3f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053d4 expref: 9 pid: 8425 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.559469:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782241305.559473:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782241305.559478:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a406 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.559489:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a406 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.559584:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241305.559645:0:8747:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a406 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241305.559648:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48818e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2398:x1868815120032256:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 303us (562us total) trans 0 rc 0/0 00010000:00010000:2.0:1782241305.559654:0:8747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a406 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241305.559657:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 88 00010000:00010000:2.0:1782241305.559677:0:8747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a406 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.559685:0:8747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a406 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.559693:0:8747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a406 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.559699:0:8747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241305.559703:0:8747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a406 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.559712:0:8747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a406 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.559725:0:8747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a406 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.559742:0:8747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1a406 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241305.559822:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2397:x1868815120032128:12345-192.168.204.58@tcp:1:lhsmtool_posix.0 Request processed in 6364us (6628us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241305.559831:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 65 00000100:00100000:0.0:1782241305.562848:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241305.562986:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120032512 00000100:00100000:2.0:1782241305.562999:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120032512 00000100:00100000:2.0:1782241305.563076:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 201 00000100:00100000:2.0:1782241305.563087:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:12371:x1868815120032512:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782241305.563198:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a40d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.563219:0:10147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a254 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350535d expref: 19 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.563240:0:10147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a40d lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.563285:0:10147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a254 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350535d expref: 19 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.563300:0:10147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a254 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350535d expref: 19 pid: 11191 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241305.563318:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4822b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140010880:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241305.563428:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e412ed180 going to sleep for 11 seconds 00000100:00100000:3.0:1782241305.570386:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4822b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140010880:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241305.570432:0:10147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a40d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241305.571423:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241305.571465:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120032640 00000100:00100000:3.0:1782241305.571473:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120032640 00010000:00010000:3.0:1782241305.571524:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a254 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350535d expref: 20 pid: 11191 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241305.571593:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 89 00000100:00100000:3.0:1782241305.571604:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:2398:x1868815120032640:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241305.571625:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241305.571634:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a254 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350535d expref: 20 pid: 11191 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.571646:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a254 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350535d expref: 20 pid: 11191 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.571673:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a254 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350535d expref: 20 pid: 11191 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.571691:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:3.0:1782241305.571696:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a40d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.571708:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a40d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.571716:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a40d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.571749:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241305.571838:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:2398:x1868815120032640:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 235us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241305.571846:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 89 00010000:00010000:3.0:1782241305.571875:0:10147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a40d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.571890:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a40d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.572117:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a414 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.572131:0:10147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a3d5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053bf expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.572603:0:10147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a414 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.572647:0:10147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a3d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053bf expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.572664:0:10147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a3d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053bf expref: 19 pid: 6511 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241305.572681:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48818380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140011008:192.168.204.58@tcp:104: 00000100:00100000:3.0:1782241305.573302:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982780 going to sleep for 11 seconds 00000100:00100000:3.0:1782241305.576476:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48818380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140011008:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241305.576517:0:10147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a414 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241305.576838:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241305.576977:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120032768 00000100:00100000:0.0:1782241305.576986:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120032768 00010000:00010000:0.0:1782241305.577033:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a3d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053bf expref: 20 pid: 6511 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241305.577104:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 90 00000100:00100000:0.0:1782241305.577116:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48818380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:2399:x1868815120032768:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241305.577134:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241305.577152:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a3d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053bf expref: 20 pid: 6511 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.577165:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a3d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053bf expref: 20 pid: 6511 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.577193:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a3d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053bf expref: 20 pid: 6511 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.577212:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:0.0:1782241305.577217:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a414 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.577227:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a414 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.577236:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a414 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.577273:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241305.577331:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48818380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:2399:x1868815120032768:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 217us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241305.577339:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 90 00010000:00010000:2.0:1782241305.577456:0:10147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a414 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.577464:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a414 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782241305.577627:0:10147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:2.0:1782241305.577939:0:10147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000001:00080000:2.0:1782241305.577984:0:10147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:2.0:1782241305.578086:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48229880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10147:1868815140011136:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782241305.578218:0:10147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241305.578293:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77983cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241305.578999:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140011136 00000100:00100000:0.0:1782241305.579023:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140011136 00000100:00100000:0.0:1782241305.579081:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1782241305.579091:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10147:x1868815140011136:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782241305.579248:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10147:x1868815140011136:12345-0@lo:1000:mdt00_003.0 Request processed in 159us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241305.579256:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1782241305.579461:0:10147:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1782241305.579471:0:10147:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff890d48819180, transno 4294967316 00000100:00100000:3.0:1782241305.579503:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48229880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10147:1868815140011136:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1782241305.579695:0:10147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00000100:00100000:3.0:1782241305.579814:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48818700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10147:1868815140011264:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782241305.579856:0:10147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241305.579885:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e779823c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241305.579904:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140011264 00000100:00100000:3.0:1782241305.579909:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140011264 00000100:00100000:3.0:1782241305.579940:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782241305.579947:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10147:x1868815140011264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782241305.580068:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10147:x1868815140011264:12345-0@lo:1000:mdt00_003.0 Request processed in 121us (211us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1782241305.580075:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782241305.580111:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48818700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10147:1868815140011264:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1782241305.580574:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a414 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.580586:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a414 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.580595:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a414 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.580601:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241305.580607:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a414 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.580616:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a414 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.580651:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:3.0:1782241305.580655:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782241305.580661:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a414 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.580668:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a414 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.580698:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a350 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.581239:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a350 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.581250:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a350 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.581256:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ebc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241305.581260:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a350 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.581267:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a350 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.581277:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:3.0:1782241305.581280:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782241305.581283:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a350 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.581288:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a350 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.581329:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a41b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.581346:0:10147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a36c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053a3 expref: 22 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.581357:0:10147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a41b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.581398:0:10147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a36c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053a3 expref: 22 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.581416:0:10147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a36c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053a3 expref: 22 pid: 11191 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241305.581431:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140011392:192.168.204.58@tcp:104: 00000100:00100000:3.0:1782241305.583775:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241305.595842:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241305.595902:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120032896 00000100:00100000:0.0:1782241305.595914:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120032896 00010000:00010000:0.0:1782241305.595968:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a36c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053a3 expref: 23 pid: 11191 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241305.596016:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 91 00000100:00100000:0.0:1782241305.596028:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+23:2398:x1868815120032896:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241305.596048:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241305.596057:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a36c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053a3 expref: 23 pid: 11191 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.596072:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a36c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053a3 expref: 23 pid: 11191 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.596101:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:0.0:1782241305.596107:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a41b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.596118:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a41b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.596253:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a41b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.596279:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241305.596341:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+23:2398:x1868815120032896:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 313us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241305.596350:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 91 00010000:00010000:1.0:1782241305.596493:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a36c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053a3 expref: 22 pid: 11191 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241305.596511:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140011392:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241305.596555:0:10147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a41b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.596567:0:10147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a41b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.596574:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a41b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.596590:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a41b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.596599:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a41b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.596616:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a41b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.596624:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241305.596630:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a41b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.596638:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a41b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.596648:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241305.596652:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241305.596656:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a41b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.596662:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1a41b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.596675:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a40d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.596681:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a40d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.596686:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a40d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.596692:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241305.596694:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a40d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.596712:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a40d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.596721:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e528b3700) 00010000:00010000:1.0:1782241305.596724:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782241305.596727:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a40d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.596732:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a40d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241305.596950:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:12371:x1868815120032512:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 33864us (34114us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1782241305.596961:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 201 00000020:00080000:1.0:1782241305.596966:0:10147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1782241305.597847:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782241305.597856:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1782241305.601009:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000040:00080000:0.0:1782241305.601119:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1782241305.601135:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782241305.604043:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120033152 00000100:00100000:3.0:1782241305.604066:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120033152 00000100:00100000:3.0:1782241305.608816:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 50 00000100:00100000:3.0:1782241305.608856:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:12371:x1868815120033152:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782241305.609307:0:6513:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782241305.609350:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967471 00010000:00010000:3.0:1782241305.609389:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e1a422 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.609408:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e1a422 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.609434:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e1a422 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.609444:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e1a422 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.609452:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e1a422 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.609459:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e1a422 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.609484:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782241305.609633:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+23:12371:x1868815120033152:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 792us (8638us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1782241305.609642:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 50 00000020:00080000:3.0:1782241305.609651:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782241305.616630:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241305.616651:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e1a422 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.616667:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164ce00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241305.616673:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e1a422 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.616686:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e1a422 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.616710:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:3.0:1782241305.616714:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782241305.616727:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e1a422 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.616734:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e1a422 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.616754:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782241305.617068:0:14612:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782241305.617075:0:14612:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:3.0:1782241305.617106:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782241305.617107:0:14612:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00010000:00010000:3.0:1782241305.617111:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782241305.617115:0:14612:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782241305.749491:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241305.754733:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120033408 00000100:00100000:1.0:1782241305.754778:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120033408 00000100:00100000:1.0:1782241305.754869:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 202 00000100:00100000:1.0:1782241305.754882:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+23:12381:x1868815120033408:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241305.754915:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241305.754954:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a429 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335053db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.755103:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e1a430 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.755122:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e1a430 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.755350:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e1a430 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241305.755366:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1782241305.755496:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a429 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053db expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.755515:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e1a430 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053db expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.755536:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:1.0:1782241305.755540:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782241305.755544:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb600, rc 0) 00000100:00100000:1.0:1782241305.755640:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+25:12381:x1868815120033408:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 760us (6162us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1782241305.755649:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 202 00000100:00100000:3.0:1782241305.759050:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241305.759477:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120033536 00000100:00100000:0.0:1782241305.759492:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120033536 00000100:00100000:0.0:1782241305.759580:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 203 00000100:00100000:0.0:1782241305.759593:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+25:12381:x1868815120033536:12345-192.168.204.58@tcp:34:lfs.0 00010000:00010000:0.0:1782241305.759721:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a43e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.759745:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a43e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.759782:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a43e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.759801:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a445 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.759827:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a445 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.759834:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a445 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.759942:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a44c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760128:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a44c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760191:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a44c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782241305.760253:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a44c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760269:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a43e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760276:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a43e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760284:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a43e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760290:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1a00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241305.760295:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a43e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760303:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a43e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760327:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:0.0:1782241305.760330:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241305.760337:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a43e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760345:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a43e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760363:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a445 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760370:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a445 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760376:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a445 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760381:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241305.760383:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a445 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760389:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a445 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760396:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890d4195c800) 00010000:00010000:0.0:1782241305.760398:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241305.760400:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a445 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760406:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a445 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760431:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a44c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760437:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a44c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760442:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a44c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760446:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241305.760449:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a44c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760455:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a44c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760461:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890d4195c500) 00010000:00010000:0.0:1782241305.760463:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241305.760466:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a44c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.760471:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a44c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241305.760588:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+25:12381:x1868815120033536:12345-192.168.204.58@tcp:34:lfs.0 Request processed in 996us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241305.760598:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 203 00000100:00100000:3.0:1782241305.843492:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241305.844072:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120033792 00000100:00100000:1.0:1782241305.844095:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120033792 00000100:00100000:1.0:1782241305.844263:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 204 00000100:00100000:1.0:1782241305.844277:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+25:12384:x1868815120033792:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241305.844307:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241305.844330:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a453 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335053e2 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.844429:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a45a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.844461:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a45a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.844475:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a45a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.844493:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a461 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.844501:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a461 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.844508:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a461 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.844934:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a468 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845006:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a468 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845016:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a468 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241305.845030:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1782241305.845258:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a45a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845268:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a45a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845275:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a45a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845290:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eae00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241305.845295:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a45a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845304:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a45a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845321:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:1.0:1782241305.845325:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241305.845331:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a45a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845337:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a45a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845355:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a461 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845362:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a461 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845367:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a461 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845373:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ebe00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241305.845376:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a461 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845381:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a461 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845400:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890e81fbc000) 00010000:00010000:1.0:1782241305.845403:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241305.845406:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a461 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845413:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a461 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845469:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a453 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e2 expref: 28 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845485:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a468 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e2 expref: 27 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.845493:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e81fbc200) 00010000:00010000:1.0:1782241305.845496:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241305.845499:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ebc00, rc 0) 00000100:00100000:1.0:1782241305.846408:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:12384:x1868815120033792:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 2128us (2922us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1782241305.846421:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 204 00000100:00100000:0.0:1782241305.858436:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241305.862359:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140011520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782241305.862462:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241305.863060:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140011520 00000100:00100000:3.0:1782241305.863070:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140011520 00000100:00100000:3.0:1782241305.863149:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782241305.863161:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140011520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782241305.863209:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1782241305.864161:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120033920 00000100:00100000:1.0:1782241305.864368:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120033920 00000100:00100000:1.0:1782241305.864599:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 205 00000100:00100000:1.0:1782241305.864611:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:12384:x1868815120033920:12345-192.168.204.58@tcp:54:lfs.0 00010000:00010000:1.0:1782241305.864705:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a476 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.864727:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a476 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.864783:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a476 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.864847:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a476 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.864856:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a476 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.864865:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a476 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.864873:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241305.864878:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a476 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.864886:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a476 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.864903:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e81fbc200) 00010000:00010000:1.0:1782241305.864907:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782241305.864913:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a476 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.864919:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a476 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241305.865031:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:12384:x1868815120033920:12345-192.168.204.58@tcp:54:lfs.0 Request processed in 421us (6608us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241305.865040:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 205 00000100:00100000:3.0:1782241305.865623:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140011520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2459us (3155us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241305.865634:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1782241305.871745:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140011520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782241305.881160:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241305.881261:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120034176 00000100:00100000:1.0:1782241305.881309:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120034176 00000100:00100000:1.0:1782241305.881390:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 51 00000100:00100000:1.0:1782241305.881403:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:12384:x1868815120034176:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:1.0:1782241305.881750:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+28:12384:x1868815120034176:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 348us (605us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1782241305.881807:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 51 00000100:00100000:0.0:1782241305.914680:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241305.914810:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120034432 00000100:00100000:1.0:1782241305.914825:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120034432 00000100:00100000:1.0:1782241305.914971:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 206 00000100:00100000:1.0:1782241305.914983:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+28:11916:x1868815120034432:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:1.0:1782241305.915241:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241305.915271:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a47d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335053e9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.915423:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a484 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.915441:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a468 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e2 expref: 29 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.915451:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a484 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.915495:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a468 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e2 expref: 29 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.915510:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a468 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e2 expref: 29 pid: 10147 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241305.915563:0:6511:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1868815140011648:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241305.915822:0:6511:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a28300 going to sleep for 11 seconds 00000100:00100000:1.0:1782241305.924423:0:6511:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1868815140011648:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241305.924470:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a484 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241305.927519:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241305.927745:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120034560 00000100:00100000:1.0:1782241305.927801:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120034560 00010000:00010000:1.0:1782241305.927871:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a468 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e2 expref: 30 pid: 10147 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241305.927914:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 92 00000100:00100000:1.0:1782241305.927926:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+30:2399:x1868815120034560:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241305.927950:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241305.927958:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a468 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e2 expref: 30 pid: 10147 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.927973:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a468 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e2 expref: 30 pid: 10147 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.928269:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a468 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e2 expref: 30 pid: 10147 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.928292:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e81fbc200) 00010000:00010000:1.0:1782241305.928297:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a484 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.928319:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a484 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.928329:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a484 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.928371:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241305.928467:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+29:2399:x1868815120034560:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 542us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241305.928477:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 92 00010000:00010000:0.0:1782241305.928555:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a484 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.928565:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a484 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241305.928593:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1782241305.928819:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb400/0xc9959f2fb1e1a47d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e9 expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.928845:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a484 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e9 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.928853:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e81fbc200) 00010000:00010000:0.0:1782241305.928856:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782241305.928859:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea600, rc 0) 00000100:00100000:0.0:1782241305.928897:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+29:11916:x1868815120034432:12345-192.168.204.58@tcp:101:bash.0 Request processed in 13916us (14234us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1782241305.928904:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 206 00000100:00100000:0.0:1782241305.937986:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241305.938162:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120034688 00000100:00100000:1.0:1782241305.938175:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120034688 00000100:00100000:1.0:1782241305.938257:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 207 00000100:00100000:1.0:1782241305.938268:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+29:11916:x1868815120034688:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:1.0:1782241305.938301:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241305.938327:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a492 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335053f0 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.938369:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a499 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.938387:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a499 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.938399:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a499 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.938563:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a492 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053f0 expref: 31 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.938599:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a499 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053f0 expref: 30 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241305.938609:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e81fbc200) 00010000:00010000:1.0:1782241305.938613:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782241305.938617:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ebe00, rc 0) 00000100:00100000:1.0:1782241305.938701:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+30:11916:x1868815120034688:12345-192.168.204.58@tcp:101:bash.0 Request processed in 434us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241305.938709:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 207 00000100:00100000:3.0:1782241305.949865:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241305.950175:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120034944 00000100:00100000:2.0:1782241305.950189:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120034944 00000100:00100000:2.0:1782241305.950254:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 208 00000100:00100000:2.0:1782241305.950265:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+30:11916:x1868815120034944:12345-192.168.204.58@tcp:36:bash.0 00010000:00010000:2.0:1782241305.951278:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e1a4a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.951315:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e1a4a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.951329:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e1a4a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782241305.951423:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000004:00010000:2.0:1782241305.951447:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bf25649f reply state 000000001ef918b4 transno 4294967478 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e1a4a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.951474:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e1a4a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241305.951483:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e81fbc200) 00010000:00010000:2.0:1782241305.951487:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782241305.951492:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1782241305.951552:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967478 00000100:00100000:2.0:1782241305.951691:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+34:11916:x1868815120034944:12345-192.168.204.58@tcp:36:bash.0 Request processed in 1424us (1841us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1782241305.951702:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 208 00000020:00080000:2.0:1782241305.951710:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1782241305.956143:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241305.956382:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120035072 00000100:00100000:0.0:1782241305.956396:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120035072 00000100:00100000:0.0:1782241305.956487:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 209 00000100:00100000:0.0:1782241305.956502:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4822b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+34:11916:x1868815120035072:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:0.0:1782241305.956548:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241305.956577:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a4a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335053f7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.957258:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a4a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053f7 expref: 35 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.957296:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a4a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053f7 expref: 35 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241305.957323:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e81fbc200) 00010000:00010000:0.0:1782241305.957327:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782241305.957330:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1600, rc 0) 00000100:00100000:0.0:1782241305.957409:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4822b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+35:11916:x1868815120035072:12345-192.168.204.58@tcp:101:bash.0 Request processed in 909us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241305.957418:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 209 00000100:00100000:0.0:1782241305.963404:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241305.963558:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120035200 00000100:00100000:3.0:1782241305.963572:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120035200 00000100:00100000:3.0:1782241305.963646:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 66 00000100:00100000:3.0:1782241305.963658:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:11916:x1868815120035200:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:3.0:1782241305.963685:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241305.963712:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e95febcd/0xc9959f2fb1e1a4ae lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335053fe expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782241305.963921:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a3ad818, atime: 0x6a3ad816, ctime: 0x6a3ad818, blocks: 0x8 00010000:00010000:3.0:1782241305.963951:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1782241305.963956:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241305.963966:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e95febcd/0xc9959f2fb1e1a4ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053fe expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.963988:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e95febcd/0xc9959f2fb1e1a4ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053fe expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241305.964003:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c400, rc 0) 00000100:00100000:3.0:1782241305.964082:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:11916:x1868815120035200:12345-192.168.204.58@tcp:101:bash.0 Request processed in 426us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241305.964091:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 66 00000100:00100000:3.0:1782241305.972405:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241305.972547:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120035328 00000100:00100000:1.0:1782241305.972561:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120035328 00002000:00010000:1.0:1782241305.972626:0:8431:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1782241305.972632:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d4881b100 with x1868815120035328 ext(0->18446744073709551615) 00002000:00010000:1.0:1782241305.972650:0:8431:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff890d4881b100. 00000100:00100000:1.0:1782241305.972697:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:1.0:1782241305.972708:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2398:x1868815120035328:12345-192.168.204.58@tcp:10:bash.0 00002000:00010000:1.0:1782241305.973129:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1782241305.973134:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1782241304 -> 1782241306 00002000:00010000:1.0:1782241305.973136:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1782241302 -> 1782241302 00002000:00010000:1.0:1782241305.973139:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1782241304 -> 1782241306 00002000:00010000:1.0:1782241305.973141:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1782241305.973431:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2398:x1868815120035328:12345-192.168.204.58@tcp:10:bash.0 Request processed in 721us (1039us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1782241305.973442:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 5 00002000:00010000:1.0:1782241305.973454:0:8431:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1782241305.973457:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d4881b100 with x1868815120035328 ext(0->18446744073709551615) 00002000:00010000:1.0:1782241305.973464:0:8431:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff890d4881b100. 00000100:00100000:2.0:1782241306.047281:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241306.047619:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120035456 00000100:00100000:0.0:1782241306.047632:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120035456 00000100:00100000:0.0:1782241306.048230:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 210 00000100:00100000:0.0:1782241306.048246:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4689bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+35:12398:x1868815120035456:12345-192.168.204.58@tcp:34:lfs.0 00010000:00010000:0.0:1782241306.048347:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a4b5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048369:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048382:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048402:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a4bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048411:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048441:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048542:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a4c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048553:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048560:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782241306.048618:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048632:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048639:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a4b5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048647:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a4b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048654:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241306.048659:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a4b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048667:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a4b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048680:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:0.0:1782241306.048690:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241306.048696:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a4b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048713:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0600/0xc9959f2fb1e1a4b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048732:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048738:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a4bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048743:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a4bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048748:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1a00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241306.048751:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a4bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048798:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a4bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048806:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890d4195c500) 00010000:00010000:0.0:1782241306.048809:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241306.048811:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a4bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048817:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a4bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048834:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048847:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a4c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048853:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048859:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241306.048862:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048869:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a4c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048877:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e81fbc200) 00010000:00010000:0.0:1782241306.048879:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241306.048887:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a4c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.048893:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0200/0xc9959f2fb1e1a4c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241306.049481:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4689bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+35:12398:x1868815120035456:12345-192.168.204.58@tcp:34:lfs.0 Request processed in 1235us (2211us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241306.049494:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 210 00000100:00100000:3.0:1782241306.084738:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241306.084882:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120035712 00000100:00100000:2.0:1782241306.084895:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120035712 00000100:00100000:2.0:1782241306.084976:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 211 00000100:00100000:2.0:1782241306.084989:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+35:12401:x1868815120035712:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241306.085017:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241306.085044:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a4ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505405 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.085549:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a4d1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.085570:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.085604:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.085625:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a4d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.085632:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.085639:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.085835:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a4df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.085846:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a4df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.085852:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a4df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241306.085863:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782241306.085969:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.085977:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a4d1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.085984:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a4d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.085990:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241306.086002:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a4d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.086009:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a4d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.086025:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:2.0:1782241306.086029:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241306.086034:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a4d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.086041:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a4d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.086057:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.086064:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a4d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.086070:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.086171:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241306.086175:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.086182:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.086191:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890e4bb38600) 00010000:00010000:2.0:1782241306.086193:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241306.086272:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a4d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.086280:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a4d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.086408:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a4ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505405 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.086553:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a4df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505405 expref: 37 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.086562:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e81fbc200) 00010000:00010000:2.0:1782241306.086565:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782241306.086568:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad200, rc 0) 00000100:00100000:2.0:1782241306.086750:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+37:12401:x1868815120035712:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 1763us (2026us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1782241306.086809:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 211 00000100:00100000:2.0:1782241306.095450:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241306.095639:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120035840 00000100:00100000:1.0:1782241306.095653:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120035840 00000100:00100000:1.0:1782241306.095742:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 212 00000100:00100000:1.0:1782241306.095774:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+37:12401:x1868815120035840:12345-192.168.204.58@tcp:54:lfs.0 00010000:00010000:1.0:1782241306.095870:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a4ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.095902:0:10147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a484 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e9 expref: 37 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.095915:0:10147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a4ed lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.095977:0:10147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a484 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e9 expref: 37 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.095996:0:10147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a484 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e9 expref: 37 pid: 6511 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241306.096018:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140011776:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241306.096168:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a280c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241306.102026:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140011776:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241306.102070:0:10147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a4ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241306.102277:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241306.102394:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120036096 00000100:00100000:1.0:1782241306.102404:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120036096 00000100:00100000:1.0:1782241306.102916:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 52 00000100:00100000:1.0:1782241306.102930:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+38:6166:x1868815120036096:12345-192.168.204.58@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1782241306.105434:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+39:6166:x1868815120036096:12345-192.168.204.58@tcp:35:ldlm_bl.0 Request processed in 2490us (3143us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1782241306.105990:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 52 00000100:00100000:3.0:1782241306.108567:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241306.116029:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120036224 00000100:00100000:1.0:1782241306.116052:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120036224 00010000:00010000:1.0:1782241306.116120:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a484 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e9 expref: 39 pid: 6511 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241306.116195:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 93 00000100:00100000:1.0:1782241306.116207:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48819500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+39:2399:x1868815120036224:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241306.116227:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241306.116235:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a484 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e9 expref: 39 pid: 6511 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.116252:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a484 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e9 expref: 39 pid: 6511 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.116280:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a484 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053e9 expref: 39 pid: 6511 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.116301:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e81fbc200) 00010000:00010000:1.0:1782241306.116325:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a4ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.116338:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a4ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.116348:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a4ed lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.116389:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241306.116482:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48819500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+38:2399:x1868815120036224:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 276us (7928us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241306.116492:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 93 00010000:00010000:3.0:1782241306.121019:0:10147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a4ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.121040:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a4ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.121096:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a4ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.121103:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a4ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.121131:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a4ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.121139:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ebc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241306.123331:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a4ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.123350:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a4ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.123376:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e81fbc200) 00010000:00010000:3.0:1782241306.123379:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782241306.123387:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a4ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.123395:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a4ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241306.124837:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+37:12401:x1868815120035840:12345-192.168.204.58@tcp:54:lfs.0 Request processed in 29069us (29385us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241306.124853:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 212 00000100:00100000:3.0:1782241306.133534:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241306.135062:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120036480 00000100:00100000:1.0:1782241306.135149:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120036480 00000100:00100000:1.0:1782241306.135243:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 53 00000100:00100000:1.0:1782241306.135256:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+37:12401:x1868815120036480:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:1.0:1782241306.136413:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+38:12401:x1868815120036480:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 1024us (2765us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1782241306.136430:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 53 00010000:00010000:2.0:1782241306.245422:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241306.270554:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241306.272629:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120036736 00000100:00100000:1.0:1782241306.272651:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120036736 00000100:00100000:1.0:1782241306.272772:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 213 00000100:00100000:1.0:1782241306.272786:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+38:12412:x1868815120036736:12345-192.168.204.58@tcp:101:cat.0 00010000:00010000:1.0:1782241306.272818:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241306.272846:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a4f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350540c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.272953:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a4fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.272990:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a4fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273007:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a4fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273410:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a502 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273421:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273429:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273583:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1a509 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273594:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1a509 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273602:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1a509 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241306.273614:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1782241306.273711:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a4fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273719:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a4fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273727:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a4fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273743:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241306.273749:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a4fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273790:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a4fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273805:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:1.0:1782241306.273809:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241306.273815:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a4fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273822:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a4fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273840:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273846:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a502 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273853:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a502 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273858:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241306.273860:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a502 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273866:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a502 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273883:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890e81fbc000) 00010000:00010000:1.0:1782241306.273885:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241306.273888:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a502 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273894:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a502 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273950:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a4f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350540c expref: 41 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273966:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1a509 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350540c expref: 40 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.273974:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e81fbc200) 00010000:00010000:1.0:1782241306.273976:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241306.273979:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea800, rc 0) 00000100:00100000:1.0:1782241306.274379:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+40:12412:x1868815120036736:12345-192.168.204.58@tcp:101:cat.0 Request processed in 1594us (3836us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1782241306.274390:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 213 00000100:00100000:2.0:1782241306.284373:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241306.284523:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120036992 00000100:00100000:3.0:1782241306.284538:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120036992 00000100:00100000:3.0:1782241306.284622:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 54 00000100:00100000:3.0:1782241306.284635:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+40:12412:x1868815120036992:12345-192.168.204.58@tcp:35:cat.0 00000100:00100000:3.0:1782241306.285158:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+41:12412:x1868815120036992:12345-192.168.204.58@tcp:35:cat.0 Request processed in 522us (799us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1782241306.285191:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 54 00000100:00100000:3.0:1782241306.307895:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241306.308063:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120037248 00000100:00100000:1.0:1782241306.308078:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120037248 00000100:00100000:1.0:1782241306.308173:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 214 00000100:00100000:1.0:1782241306.308187:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+41:12413:x1868815120037248:12345-192.168.204.58@tcp:36:rm.0 00010000:00010000:1.0:1782241306.308270:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1782241306.308307:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1600/0xc9959f2fb1e1a4a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053f7 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.308361:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1a509 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350540c expref: 40 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.308374:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a4df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505405 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.308387:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a499 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053f0 expref: 38 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.308397:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e81fbc200) 00010000:00010000:1.0:1782241306.308403:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241306.308432:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a517 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.308447:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a517 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.308457:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a517 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.308473:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a51e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.308480:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a51e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.308487:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a51e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.308640:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a525 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.308649:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a525 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.308656:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a525 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782241306.309467:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:1.0:1782241306.309557:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a52c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.309571:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a52c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.309581:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a52c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.309590:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a52c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.309742:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a52c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.309751:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a52c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.309960:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241306.309994:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a525 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.310001:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a525 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.310023:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a525 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.310030:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241306.310035:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a525 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.310044:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a525 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.310058:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e81fbc200) 00010000:00010000:0.0:1782241306.310061:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782241306.310067:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a525 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.310074:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a525 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.310107:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a517 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.310114:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a517 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.310120:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a517 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.310125:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241306.310128:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a517 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.310155:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a517 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.310164:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:0.0:1782241306.310167:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241306.310170:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a517 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.310177:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a517 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782241306.310189:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d607fd5 reply state 000000006d78a60a transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a51e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.310201:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a51e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.310207:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890e81fbc000) 00010000:00010000:0.0:1782241306.310209:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782241306.310212:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782241306.310380:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+39:12413:x1868815120037248:12345-192.168.204.58@tcp:36:rm.0 Request processed in 2192us (2496us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1782241306.310391:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 214 00010000:00010000:3.0:1782241306.310591:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241306.310889:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a52c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.310897:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241306.310900:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a52c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.310908:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a52c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.310919:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e81fbc200) 00010000:00010000:3.0:1782241306.310922:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782241306.310925:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a52c lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.310931:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a52c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.310944:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241306.310946:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241306.310948:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241306.368342:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241306.368481:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120037504 00000100:00100000:3.0:1782241306.368494:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120037504 00000100:00100000:3.0:1782241306.368589:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 215 00000100:00100000:3.0:1782241306.368611:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+39:12419:x1868815120037504:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:3.0:1782241306.368646:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241306.368704:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e1a533 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505413 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.371930:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a53a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.371960:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a53a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.371975:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a53a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.372009:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a541 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.372017:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a541 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.372024:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a541 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782241306.372452:0:10147:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1782241306.372644:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a548 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.372656:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a548 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.372665:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a548 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.372715:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a53a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.372724:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a53a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.372731:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a53a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.372738:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241306.372743:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a53a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.374880:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a53a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.374903:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:2.0:1782241306.374906:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241306.374912:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a53a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.374920:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a53a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782241306.374938:0:10147:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c48c2b8f reply state 00000000090035dc transno 4294967486 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a541 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.374952:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a541 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.374960:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890e81fbc000) 00010000:00010000:2.0:1782241306.374962:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782241306.374966:0:10147:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782241306.375030:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e1a533 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505413 expref: 42 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.375048:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a548 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505413 expref: 41 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.375056:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e4bb38600) 00010000:00010000:2.0:1782241306.375058:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241306.375060:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad600, rc 0) 00000100:00100000:2.0:1782241306.375227:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+42:12419:x1868815120037504:12345-192.168.204.58@tcp:101:bash.0 Request processed in 6617us (6898us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1782241306.375238:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 215 00000100:00100000:2.0:1782241306.388409:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241306.388556:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120037632 00000100:00100000:1.0:1782241306.388571:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120037632 00000100:00100000:1.0:1782241306.388687:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 67 00000100:00100000:1.0:1782241306.388711:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2398:x1868815120037632:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:1.0:1782241306.388797:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241306.388826:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1a556 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350541a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782241306.388859:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241306.388884:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=369s v=(0 0) 00010000:00010000:1.0:1782241306.388890:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241306.388903:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1a556 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350541a expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.388927:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1a556 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350541a expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.388945:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ebe00, rc 0) 00000100:00080000:0.0:1782241306.389097:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241306.389191:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2398:x1868815120037632:12345-192.168.204.58@tcp:101:bash.0 Request processed in 492us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241306.389199:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 67 00000100:00100000:3.0:1782241306.393077:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241306.394693:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120037760 00000100:00100000:2.0:1782241306.394715:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120037760 00000100:00100000:2.0:1782241306.394828:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 68 00000100:00100000:2.0:1782241306.394841:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:12419:x1868815120037760:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:2.0:1782241306.394872:0:8747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241306.394895:0:8747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1a55d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505421 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.394945:0:8747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1a556 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350541a expref: 9 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.394956:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241306.394961:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241306.394966:0:8747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1a55d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505421 expref: 9 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.395013:0:8747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1a556 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350541a expref: 9 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.395029:0:8747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1a556 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350541a expref: 9 pid: 8426 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241306.395054:0:8747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:8747:1868815140011904:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241306.396670:0:8747:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d46869900 going to sleep for 11 seconds 00000100:00100000:0.0:1782241306.401995:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241306.402540:0:8747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:8747:1868815140011904:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241306.402583:0:8747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1a55d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505421 expref: 9 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.402612:0:8747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad400, rc 0) 00000100:00100000:2.0:1782241306.402702:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:12419:x1868815120037760:12345-192.168.204.58@tcp:101:bash.0 Request processed in 7863us (9640us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241306.402713:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 68 00000100:00100000:3.0:1782241306.404135:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120037888 00000100:00100000:3.0:1782241306.404151:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120037888 00010000:00010000:3.0:1782241306.404210:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1a556 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350541a expref: 9 pid: 8426 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241306.404316:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 94 00000100:00100000:3.0:1782241306.404328:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e436c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2399:x1868815120037888:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241306.404347:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241306.404374:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1a556 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350541a expref: 9 pid: 8426 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.404391:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1a556 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350541a expref: 9 pid: 8426 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.404423:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1a556 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350541a expref: 9 pid: 8426 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.404446:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241306.404452:0:10331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241306.404463:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1a55d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505421 expref: 8 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.404474:0:10331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1a55d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505421 expref: 8 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.404570:0:10331:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1a55d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505421 expref: 8 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241306.404588:0:10331:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48819180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10331:1868815140012032:192.168.204.58@tcp:105: 00000100:00100000:3.0:1782241306.404711:0:10331:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782241306.408737:0:10331:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48819180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10331:1868815140012032:192.168.204.58@tcp:105: 00010000:00010000:3.0:1782241306.408817:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241306.408888:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e436c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2399:x1868815120037888:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 4560us (6906us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241306.408902:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 94 00000100:00100000:1.0:1782241306.412501:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241306.412589:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120038144 00000100:00100000:3.0:1782241306.412602:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120038144 00000100:00100000:3.0:1782241306.412683:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 55 00000100:00100000:3.0:1782241306.412702:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+42:12419:x1868815120038144:12345-192.168.204.58@tcp:35:bash.0 00000100:00100000:2.0:1782241306.413360:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+43:12419:x1868815120038144:12345-192.168.204.58@tcp:35:bash.0 Request processed in 664us (880us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1782241306.413371:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 55 00000100:00100000:0.0:1782241306.530038:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241306.530134:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241306.530258:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120038272 00000100:00100000:3.0:1782241306.530272:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120038272 00002000:00100000:3.0:1782241306.530343:0:8430:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff890d48251180 x1868815120038272/t0(0) o4->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:397/0 lens 504/0 e 0 to 0 dl 1782241317 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782241306.530356:0:8430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d48251180 with x1868815120038272 ext(0->8) 00002000:00010000:3.0:1782241306.530363:0:8430:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff890d48251180 00000100:00100000:3.0:1782241306.530410:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 6 00000100:00100000:3.0:1782241306.530422:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2399:x1868815120038272:12345-192.168.204.58@tcp:4:bash.0 00000100:00100000:1.0:1782241306.531348:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120038400 00000100:00100000:1.0:1782241306.531360:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120038400 00000100:00100000:1.0:1782241306.531423:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 69 00000100:00100000:1.0:1782241306.531433:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:2399:x1868815120038400:12345-192.168.204.58@tcp:16:kworker.0 00000100:00100000:2.0:1782241306.535654:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:2399:x1868815120038272:12345-192.168.204.58@tcp:4:bash.0 Request processed in 5216us (5614us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1782241306.535672:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 6 00002000:00100000:2.0:1782241306.535689:0:8430:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff890d48251180 x1868815120038272/t4294967309(0) o4->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:397/0 lens 504/448 e 0 to 0 dl 1782241317 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782241306.535702:0:8430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d48251180 with x1868815120038272 ext(0->8) 00002000:00010000:2.0:1782241306.535711:0:8430:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff890d48251180 00000001:00080000:3.0:1782241306.556703:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1782241306.556749:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1782241306.557294:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815120038400:12345-192.168.204.58@tcp:16:kworker.0 Request processed in 25852us (27149us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241306.558044:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 69 00000100:00100000:0.0:1782241306.570305:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241306.571533:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120038528 00000100:00100000:1.0:1782241306.571550:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120038528 00000100:00100000:1.0:1782241306.573169:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 216 00000100:00100000:1.0:1782241306.573196:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+43:12435:x1868815120038528:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241306.573236:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241306.573265:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a564 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505428 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.573372:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a56b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.573391:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a56b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.573405:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a56b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241306.573466:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1782241306.573471:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241306.573501:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a56b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.573538:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebe00/0xc9959f2fb1e1a564 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505428 expref: 45 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.573561:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a56b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505428 expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.573571:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:1.0:1782241306.573575:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782241306.573598:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb800, rc 0) 00000100:00100000:1.0:1782241306.573703:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+44:12435:x1868815120038528:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 519us (3428us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241306.573712:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 216 00000100:00100000:0.0:1782241306.579709:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241306.581117:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120038784 00000100:00100000:1.0:1782241306.581133:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120038784 00000100:00100000:1.0:1782241306.581585:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 217 00000100:00100000:1.0:1782241306.581601:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+44:12435:x1868815120038784:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241306.581629:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241306.581654:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1a572 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350542f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.581826:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a579 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.581843:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a579 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.581857:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a579 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241306.581871:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1782241306.582011:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea800/0xc9959f2fb1e1a572 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350542f expref: 47 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.582031:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a579 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350542f expref: 46 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.582041:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e4bb38600) 00010000:00010000:1.0:1782241306.582063:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241306.582068:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb200, rc 0) 00000100:00100000:1.0:1782241306.582160:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+46:12435:x1868815120038784:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 563us (2464us total) trans 4294967488 rc 0/0 00000100:00100000:1.0:1782241306.582169:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 217 00000100:00100000:2.0:1782241306.586049:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241306.587373:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241306.588242:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120039168 00000100:00100000:2.0:1782241306.588256:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120039168 00000100:00100000:2.0:1782241306.588437:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:2.0:1782241306.588453:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+46:2398:x1868815120039168:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241306.588475:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241306.588633:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb200/0xc9959f2fb1e1a579 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350542f expref: 46 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.588658:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e4bb38600) 00010000:00010000:2.0:1782241306.588664:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241306.588744:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+45:2398:x1868815120039168:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 295us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241306.588870:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:1.0:1782241306.590657:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120039040 00000100:00100000:1.0:1782241306.590673:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120039040 00000100:00100000:2.0:1782241306.596390:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 218 00000100:00100000:2.0:1782241306.596410:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+45:12435:x1868815120039040:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241306.596446:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241306.596475:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a587 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505436 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.596636:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a58e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.596653:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a58e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.596665:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a58e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241306.596680:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1782241306.596849:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a587 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505436 expref: 48 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.596873:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a58e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505436 expref: 47 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.596907:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e4bb38600) 00010000:00010000:2.0:1782241306.596911:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782241306.596915:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fadc00, rc 0) 00000100:00100000:2.0:1782241306.602146:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+47:12435:x1868815120039040:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 5723us (16092us total) trans 4294967489 rc 0/0 00000100:00100000:2.0:1782241306.602175:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 218 00000100:00100000:0.0:1782241306.610119:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241306.610281:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120039296 00000100:00100000:2.0:1782241306.610293:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120039296 00000100:00100000:2.0:1782241306.610516:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 70 00000100:00100000:2.0:1782241306.610530:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2399:x1868815120039296:12345-192.168.204.58@tcp:1:lfs.0 00010000:00010000:2.0:1782241306.610594:0:8746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1a59c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.610619:0:8746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1a55d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505421 expref: 6 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.610630:0:8746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241306.610634:0:8746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782241306.610640:0:8746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1a59c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.610685:0:8746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1a55d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505421 expref: 6 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.610701:0:8746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1a55d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505421 expref: 6 pid: 8747 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241306.610739:0:8746:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8746:1868815140012160:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241306.610908:0:8746:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d46869e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241306.618557:0:8746:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8746:1868815140012160:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241306.618604:0:8746:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1a59c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241306.618886:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241306.618980:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120039424 00000100:00100000:2.0:1782241306.618990:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120039424 00010000:00010000:2.0:1782241306.619043:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1a55d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505421 expref: 7 pid: 8747 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241306.619086:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 95 00000100:00100000:2.0:1782241306.619098:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48854a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2398:x1868815120039424:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241306.619118:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1782241306.619141:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1782241306.619145:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1782241306 00002000:00010000:2.0:1782241306.619147:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1782241306 00002000:00010000:2.0:1782241306.619150:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1782241306.619167:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1a55d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505421 expref: 7 pid: 8747 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.619183:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1a55d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505421 expref: 7 pid: 8747 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.619236:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1a55d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505421 expref: 7 pid: 8747 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.619254:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782241306.619259:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782241306.619265:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1a59c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.619278:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1a59c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.619321:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241306.619394:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48854a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+6:2398:x1868815120039424:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 297us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241306.619403:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 95 00010000:00010000:1.0:1782241306.619559:0:8746:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1a59c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.619571:0:8746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1a59c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.619595:0:8746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1a59c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.619604:0:8746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1a59c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.619613:0:8746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1a59c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.619620:0:8746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43faca00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241306.619625:0:8746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1a59c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.619636:0:8746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1a59c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.619662:0:8746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1a59c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.619670:0:8746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078f4abd3/0xc9959f2fb1e1a59c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241306.620546:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815120039296:12345-192.168.204.58@tcp:1:lfs.0 Request processed in 10013us (10589us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241306.620559:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 70 00000100:00100000:0.0:1782241306.634112:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241306.634786:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120039680 00000100:00100000:2.0:1782241306.634799:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120039680 00000100:00100000:0.0:1782241306.638085:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 56 00000100:00100000:0.0:1782241306.638431:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47a48450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+47:12435:x1868815120039680:12345-192.168.204.58@tcp:35:lfs.0 00000004:00010000:0.0:1782241306.638535:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a58e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505436 expref: 47 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782241306.639291:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1782241306.639969:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1782241306.641072:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1782241306.641148:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a5a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.641171:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a548 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505413 expref: 51 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.641183:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a5a3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.641234:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a548 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505413 expref: 51 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.641253:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a548 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505413 expref: 51 pid: 10147 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241306.641292:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48855c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1868815140012288:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241306.641994:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afd540 going to sleep for 11 seconds 00000100:00100000:0.0:1782241306.644906:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48855c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1868815140012288:192.168.204.58@tcp:104: 00010000:00010000:0.0:1782241306.644950:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a5a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241306.648585:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241306.648824:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120039808 00000100:00100000:3.0:1782241306.648837:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120039808 00010000:00010000:3.0:1782241306.648895:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a548 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505413 expref: 52 pid: 10147 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241306.648966:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 96 00000100:00100000:3.0:1782241306.648977:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48855c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+52:2399:x1868815120039808:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241306.648997:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241306.649006:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a548 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505413 expref: 52 pid: 10147 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.649027:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a548 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505413 expref: 52 pid: 10147 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.649054:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a548 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505413 expref: 52 pid: 10147 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.649077:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e4bb38600) 00010000:00010000:3.0:1782241306.649084:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a5a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.649095:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a5a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.649104:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a5a3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.650314:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241306.650405:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48855c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+51:2399:x1868815120039808:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 1422us (1828us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241306.650418:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 96 00010000:00010000:0.0:1782241306.651474:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a5a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.651490:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a5a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782241306.651677:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000001:00080000:0.0:1782241306.652009:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:0.0:1782241306.652134:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48856d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1868815140012416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782241306.652272:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241306.652345:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4809c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241306.652495:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140012416 00000100:00100000:2.0:1782241306.652505:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140012416 00000100:00100000:2.0:1782241306.652589:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1782241306.652598:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1868815140012416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782241306.652727:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1868815140012416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 128us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241306.652775:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782241306.652790:0:6513:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:1.0:1782241306.652797:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:1.0:1782241306.652825:0:6513:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff890d48229c00, transno 4294967308 00000100:00100000:1.0:1782241306.652846:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48856d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1868815140012416:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1782241306.652861:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1782241306.653012:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00000100:00100000:1.0:1782241306.653065:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1868815140012544:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1782241306.653100:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241306.653131:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782241306.653293:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140012544 00000100:00100000:3.0:1782241306.653306:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140012544 00000100:00100000:3.0:1782241306.653347:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1782241306.653355:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1868815140012544:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782241306.653681:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6513:x1868815140012544:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 326us (579us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1782241306.653694:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1782241306.653994:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1868815140012544:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1782241306.654054:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:1.0:1782241306.654092:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a5a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.654100:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a5a3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.654106:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a5a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.654110:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241306.654121:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a5a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.654130:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a5a3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.654149:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e4bb38600) 00010000:00010000:1.0:1782241306.654152:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1782241306.654158:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a5a3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.654165:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a5a3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782241306.654360:0:6513:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1782241306.654426:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1782241306.654440:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 369912682747ns, next at 370912679555ns, rc = 0 00000001:00080000:1.0:1782241306.654447:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967497 00010000:00010000:1.0:1782241306.654473:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e4bb38600) 00010000:00010000:1.0:1782241306.654476:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782241306.654485:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a58e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505436 expref: 55 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241306.654626:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47a48450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+54:12435:x1868815120039680:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 16522us (20642us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1782241306.654636:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 56 00000020:00080000:1.0:1782241306.654641:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1782241306.657379:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241306.657565:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120039936 00000100:00100000:1.0:1782241306.657578:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120039936 00000100:00100000:1.0:1782241306.657678:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 219 00000100:00100000:1.0:1782241306.657688:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+54:12435:x1868815120039936:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241306.657734:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241306.657796:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a5aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350543d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.657883:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a5aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350543d expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.657902:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a5aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350543d expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.657928:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:1.0:1782241306.657931:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782241306.657936:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea600, rc 0) 00000100:00100000:1.0:1782241306.658003:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+55:12435:x1868815120039936:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 317us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241306.658019:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 219 00000100:00100000:0.0:1782241306.661250:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241306.661451:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120040192 00000100:00100000:2.0:1782241306.661463:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120040192 00000100:00100000:2.0:1782241306.661561:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 57 00000100:00100000:2.0:1782241306.661574:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+55:12435:x1868815120040192:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:2.0:1782241306.661942:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+56:12435:x1868815120040192:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 370us (707us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1782241306.661952:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 57 00000100:00100000:3.0:1782241306.728905:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241306.729495:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120040320 00000100:00100000:2.0:1782241306.729518:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120040320 00000100:00100000:2.0:1782241306.729720:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 220 00000100:00100000:2.0:1782241306.729733:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+56:12445:x1868815120040320:12345-192.168.204.58@tcp:34:lfs.0 00010000:00010000:2.0:1782241306.729902:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5b1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.729924:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.729948:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.729962:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.729970:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.729976:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730091:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a5bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730100:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a5bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730108:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a5bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782241306.730183:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a5bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730198:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730205:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5b1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730212:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730218:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241306.730223:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730230:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5b1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730244:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:2.0:1782241306.730247:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241306.730253:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730270:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730289:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730295:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730300:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730306:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43face00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241306.730309:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730315:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730324:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890e81fbc000) 00010000:00010000:2.0:1782241306.730327:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241306.730330:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730336:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730346:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a5bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730352:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a5bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730365:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a5bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730370:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fadc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241306.730373:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a5bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730380:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a5bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730388:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:2.0:1782241306.730391:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241306.730394:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a5bf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.730652:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a5bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241306.731269:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+56:12445:x1868815120040320:12345-192.168.204.58@tcp:34:lfs.0 Request processed in 1533us (2373us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241306.731282:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 220 00000100:00100000:0.0:1782241306.773821:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241306.774667:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120040576 00000100:00100000:2.0:1782241306.774681:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120040576 00000100:00100000:2.0:1782241306.774901:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 221 00000100:00100000:2.0:1782241306.774911:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+56:12448:x1868815120040576:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241306.774944:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241306.774968:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a5c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505444 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775094:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775112:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775136:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775149:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775166:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775173:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775645:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a5db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775654:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a5db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775659:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a5db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241306.775669:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1782241306.775850:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775872:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775880:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775887:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43face00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241306.775892:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775899:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775914:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:2.0:1782241306.775917:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241306.775922:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775929:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a5cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775945:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775951:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775957:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775962:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241306.775972:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775977:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775985:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890e81fbc000) 00010000:00010000:2.0:1782241306.775987:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241306.775990:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.775996:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.776041:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a5c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505444 expref: 59 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.776054:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a5db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505444 expref: 58 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.776062:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:2.0:1782241306.776064:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241306.776067:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad600, rc 0) 00000100:00100000:2.0:1782241306.776489:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+58:12448:x1868815120040576:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 1576us (2731us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1782241306.776500:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 221 00000100:00100000:0.0:1782241306.781178:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241306.781348:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120040704 00000100:00100000:1.0:1782241306.781360:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120040704 00000100:00100000:1.0:1782241306.781439:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 222 00000100:00100000:1.0:1782241306.781452:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+58:12448:x1868815120040704:12345-192.168.204.58@tcp:54:lfs.0 00010000:00010000:1.0:1782241306.781564:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a5e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.781587:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.781602:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.781681:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.781690:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a5e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.781698:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a5e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.781705:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241306.781709:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a5e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.781718:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a5e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.781734:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:1.0:1782241306.781738:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782241306.781743:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a5e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.781750:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a5e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241306.781984:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+58:12448:x1868815120040704:12345-192.168.204.58@tcp:54:lfs.0 Request processed in 533us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241306.781993:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 222 00000100:00100000:3.0:1782241306.785546:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241306.785641:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120040960 00000100:00100000:2.0:1782241306.785653:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120040960 00000100:00100000:2.0:1782241306.785727:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 58 00000100:00100000:2.0:1782241306.785740:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+58:12448:x1868815120040960:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:2.0:1782241306.786145:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:12448:x1868815120040960:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 406us (614us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1782241306.786154:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 58 00000100:00100000:0.0:1782241306.848625:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241306.848889:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120041216 00000100:00100000:2.0:1782241306.848902:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120041216 00000100:00100000:2.0:1782241306.848993:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 223 00000100:00100000:2.0:1782241306.849005:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:12458:x1868815120041216:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:2.0:1782241306.849040:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241306.849048:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782241306.849093:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1a56b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505428 expref: 59 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.849118:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:2.0:1782241306.849124:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241306.849142:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a5f0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350544b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.849287:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.849304:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a5db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505444 expref: 59 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.849314:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5f7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.849354:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a5db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505444 expref: 59 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.849464:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a5db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505444 expref: 59 pid: 10147 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241306.849480:0:6512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1868815140012672:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241306.849624:0:6512:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d46869240 going to sleep for 11 seconds 00000100:00100000:2.0:1782241306.859325:0:6512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1868815140012672:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241306.859372:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241306.859927:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241306.860021:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120041344 00000100:00100000:2.0:1782241306.860030:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120041344 00010000:00010000:2.0:1782241306.860078:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a5db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505444 expref: 60 pid: 10147 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241306.860176:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 97 00000100:00100000:2.0:1782241306.860188:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:2398:x1868815120041344:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241306.860207:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241306.860214:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a5db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505444 expref: 60 pid: 10147 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.860238:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a5db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505444 expref: 60 pid: 10147 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.860307:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a5db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505444 expref: 60 pid: 10147 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.860355:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:2.0:1782241306.860360:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.860373:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.860382:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5f7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.860416:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782241306.860555:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.860576:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241306.860601:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000100:00100000:2.0:1782241306.860708:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:2398:x1868815120041344:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 521us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241306.860714:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 97 00010000:00010000:0.0:1782241306.860956:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a5f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350544b expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.860989:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350544b expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241306.860998:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:0.0:1782241306.861001:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782241306.861004:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad400, rc 0) 00000100:00100000:0.0:1782241306.861035:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:12458:x1868815120041216:12345-192.168.204.58@tcp:101:bash.0 Request processed in 12033us (12426us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1782241306.861043:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 223 00000100:00100000:3.0:1782241306.865463:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241306.865574:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120041472 00000100:00100000:2.0:1782241306.865584:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120041472 00000100:00100000:2.0:1782241306.865684:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 224 00000100:00100000:2.0:1782241306.865705:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+59:12458:x1868815120041472:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:2.0:1782241306.865730:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241306.865749:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a605 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505452 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.865835:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a60c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.865849:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a60c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.865876:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a60c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.865993:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a605 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505452 expref: 61 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.866011:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a60c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505452 expref: 60 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.866020:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:2.0:1782241306.866022:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782241306.866025:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad600, rc 0) 00000100:00100000:2.0:1782241306.866100:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:12458:x1868815120041472:12345-192.168.204.58@tcp:101:bash.0 Request processed in 406us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241306.866107:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 224 00000100:00100000:3.0:1782241306.873992:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241306.874194:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120041728 00000100:00100000:1.0:1782241306.874209:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120041728 00000100:00100000:1.0:1782241306.874279:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 225 00000100:00100000:1.0:1782241306.874304:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+60:12458:x1868815120041728:12345-192.168.204.58@tcp:36:bash.0 00010000:00010000:1.0:1782241306.874571:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a613 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.874588:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a613 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.874601:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a613 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782241306.874650:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967503 00000004:00010000:1.0:1782241306.874676:0:6511:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d51eb70 reply state 00000000a47e979c transno 4294967504 ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a613 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.874704:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a613 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.874712:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:1.0:1782241306.874715:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782241306.874718:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782241306.874845:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:12458:x1868815120041728:12345-192.168.204.58@tcp:36:bash.0 Request processed in 542us (862us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1782241306.874852:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 225 00000020:00080000:1.0:1782241306.874857:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1782241306.878264:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241306.878360:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120041856 00000100:00100000:2.0:1782241306.878368:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120041856 00000100:00100000:2.0:1782241306.878423:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 226 00000100:00100000:2.0:1782241306.878433:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:12458:x1868815120041856:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:2.0:1782241306.878456:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241306.878473:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a61a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505459 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.878591:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.878605:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5f7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350544b expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.878622:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.878656:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350544b expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.878670:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350544b expref: 64 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241306.878693:0:6512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1868815140012800:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241306.878799:0:6512:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d46869e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241306.882616:0:6512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1868815140012800:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241306.882644:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782241306.885106:0:9979:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370143346363ns, next at 371143343627ns, rc = 0 00000100:00100000:0.0:1782241306.885197:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241306.885223:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140012928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241306.885304:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241306.886145:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140013184:0@lo:400:kworker.0 00000100:00100000:0.0:1782241306.886182:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241306.886216:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815140013696:0@lo:400:kworker.0 00000100:00100000:0.0:1782241306.886237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241306.886254:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815140014208:0@lo:400:kworker.0 00000100:00100000:0.0:1782241306.886287:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241306.886313:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782241306.886319:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48854700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140013312:0@lo:400:kworker.0 00000100:00100000:0.0:1782241306.886344:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241306.886366:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140013824:0@lo:400:kworker.0 00000100:00100000:0.0:1782241306.886385:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241306.886403:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140014336:0@lo:400:kworker.0 00000100:00100000:0.0:1782241306.886422:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241306.886449:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140013184 00000100:00100000:0.0:1782241306.886456:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140013184 00000100:00100000:0.0:1782241306.886489:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140013696 00000100:00100000:0.0:1782241306.886491:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140013696 00000100:00100000:0.0:1782241306.886523:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140014208 00000100:00100000:0.0:1782241306.886526:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140014208 00000100:00100000:0.0:1782241306.886541:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140013824 00000100:00100000:0.0:1782241306.886544:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140013824 00000100:00100000:0.0:1782241306.886556:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140014336 00000100:00100000:0.0:1782241306.886558:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140014336 00000100:00100000:0.0:1782241306.886574:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1782241306.886581:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140013184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241306.886645:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140013184:12345-0@lo:400:kworker.0 Request processed in 63us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241306.886653:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1782241306.886671:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1782241306.886677:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815140013696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241306.886726:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815140013696:12345-0@lo:400:kworker.0 Request processed in 38us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241306.886733:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1782241306.886788:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1782241306.886796:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815140014208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241306.886833:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815140014208:12345-0@lo:400:kworker.0 Request processed in 38us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241306.886839:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1782241306.886852:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1782241306.886858:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140013824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241306.886887:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140013824:12345-0@lo:400:kworker.0 Request processed in 29us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241306.886892:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1782241306.886902:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1782241306.886908:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815140014336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241306.886933:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815140014336:12345-0@lo:400:kworker.0 Request processed in 25us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241306.886938:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1782241306.886956:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140013312 00000100:00100000:0.0:1782241306.886959:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140013312 00000100:00100000:0.0:1782241306.886983:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1782241306.886988:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140013312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241306.887025:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140013312:12345-0@lo:400:kworker.0 Request processed in 36us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241306.887031:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:0.0:1782241306.887047:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241306.887051:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241306.887079:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48854700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140013312:0@lo:400:kworker.0 00010000:00080000:0.0:1782241306.887093:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4836c000 x1868815140013824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241306.887111:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140013824:0@lo:400:kworker.0 00010000:00080000:0.0:1782241306.887122:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4836e300 x1868815140014336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241306.887130:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140014336:0@lo:400:kworker.0 00000100:00100000:0.0:1782241306.887138:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140013184:0@lo:400:kworker.0 00000100:00100000:0.0:1782241306.887146:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815140013696:0@lo:400:kworker.0 00000100:00100000:0.0:1782241306.887154:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815140014208:0@lo:400:kworker.0 00000100:00100000:1.0:1782241306.887432:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140012928 00000100:00100000:1.0:1782241306.887437:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140012928 00000100:00100000:1.0:1782241306.887477:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1782241306.887485:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815140012928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782241306.887516:0:14428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782241306.887562:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815140012928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241306.887568:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1782241306.887664:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140013056:0@lo:400:kworker.0 00000100:00100000:2.0:1782241306.887700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241306.887744:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140013568:0@lo:400:kworker.0 00000100:00100000:2.0:1782241306.887783:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241306.887799:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140014080:0@lo:400:kworker.0 00000100:00100000:2.0:1782241306.887820:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241306.887855:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140012928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241306.887870:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1782241306.887875:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140013440:0@lo:400:kworker.0 00000100:00100000:2.0:1782241306.887908:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241306.887945:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140013952:0@lo:400:kworker.0 00000100:00100000:2.0:1782241306.887982:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241306.888006:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140014464:0@lo:400:kworker.0 00000100:00100000:2.0:1782241306.888029:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241306.888059:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140014080 00000100:00100000:2.0:1782241306.888063:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140014080 00000100:00100000:2.0:1782241306.888090:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140013952 00000100:00100000:2.0:1782241306.888092:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140013952 00000100:00100000:2.0:1782241306.888117:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140014464 00000100:00100000:2.0:1782241306.888119:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140014464 00000100:00100000:2.0:1782241306.888134:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782241306.888140:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815140014080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241306.888188:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815140014080:12345-0@lo:400:kworker.0 Request processed in 47us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241306.888194:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782241306.888207:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782241306.888213:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140013952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241306.888242:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140013952:12345-0@lo:400:kworker.0 Request processed in 29us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241306.888248:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782241306.888258:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1782241306.888264:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140014464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241306.888295:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140014464:12345-0@lo:400:kworker.0 Request processed in 30us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241306.888300:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1782241306.888330:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782241306.888334:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241306.888346:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140013440 00000100:00100000:2.0:1782241306.888349:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140013440 00000100:00100000:2.0:1782241306.888370:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1782241306.888375:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140013440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241306.888407:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140013440:12345-0@lo:400:kworker.0 Request processed in 31us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241306.888413:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1782241306.888436:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140013440:0@lo:400:kworker.0 00000100:00100000:2.0:1782241306.888444:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140013952:0@lo:400:kworker.0 00000100:00100000:2.0:1782241306.888452:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140014464:0@lo:400:kworker.0 00000100:00100000:2.0:1782241306.888460:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140014080:0@lo:400:kworker.0 00000100:00100000:3.0:1782241306.888546:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140013056 00000100:00100000:3.0:1782241306.888552:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140013056 00000100:00100000:3.0:1782241306.888587:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1782241306.888594:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815140013056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241306.888633:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815140013056:12345-0@lo:400:kworker.0 Request processed in 39us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241306.888639:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1782241306.888668:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140013568 00000100:00100000:3.0:1782241306.888671:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140013568 00000100:00100000:3.0:1782241306.888695:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1782241306.888702:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140013568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241306.888745:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140013568:12345-0@lo:400:kworker.0 Request processed in 30us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241306.888752:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1782241306.888799:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140013056:0@lo:400:kworker.0 00000100:00100000:3.0:1782241306.888809:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140013568:0@lo:400:kworker.0 00000100:00100000:3.0:1782241306.890320:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241306.891109:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120041984 00000100:00100000:2.0:1782241306.891119:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120041984 00010000:00010000:2.0:1782241306.891157:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350544b expref: 65 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241306.891198:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 98 00000100:00100000:2.0:1782241306.891207:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48819180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+65:2399:x1868815120041984:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241306.891221:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241306.891228:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350544b expref: 65 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.891241:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350544b expref: 65 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.891285:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a5f7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350544b expref: 65 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.891299:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:2.0:1782241306.891304:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.891315:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.891324:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241306.891357:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241306.891411:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48819180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+64:2399:x1868815120041984:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 204us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241306.891419:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 98 00010000:00010000:3.0:1782241306.892911:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.892996:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241306.893118:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1782241306.893123:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782241306.893147:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.893187:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a61a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505459 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.893208:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505459 expref: 63 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.893217:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:3.0:1782241306.893221:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782241306.893225:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad200, rc 0) 00000100:00100000:3.0:1782241306.893444:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:12458:x1868815120041856:12345-192.168.204.58@tcp:101:bash.0 Request processed in 15011us (15187us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241306.893453:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 226 00000100:00100000:3.0:1782241306.902185:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241306.902263:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120042240 00000100:00100000:1.0:1782241306.902273:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120042240 00000100:00100000:1.0:1782241306.902334:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 59 00000100:00100000:1.0:1782241306.902345:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+63:12458:x1868815120042240:12345-192.168.204.58@tcp:35:bash.0 00000100:00100000:1.0:1782241306.902591:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+64:12458:x1868815120042240:12345-192.168.204.58@tcp:35:bash.0 Request processed in 246us (414us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1782241306.902600:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 59 00000100:00100000:0.0:1782241306.980331:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241306.980450:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120042368 00000100:00100000:1.0:1782241306.980460:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120042368 00000100:00100000:1.0:1782241306.980529:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 227 00000100:00100000:1.0:1782241306.980539:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+64:12464:x1868815120042368:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:1.0:1782241306.980566:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241306.980588:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a628 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505460 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.980653:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a62f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.980667:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a62f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.980690:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a62f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241306.980734:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1782241306.980738:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241306.980810:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a62f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.980838:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ebc00/0xc9959f2fb1e1a628 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505460 expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.980856:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a62f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505460 expref: 65 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241306.980865:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:1.0:1782241306.980868:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782241306.980872:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eae00, rc 0) 00000100:00100000:1.0:1782241306.980940:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+65:12464:x1868815120042368:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 403us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241306.980948:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 227 00000100:00100000:2.0:1782241306.993882:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241306.994009:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120042496 00000100:00100000:3.0:1782241306.994020:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120042496 00000100:00100000:3.0:1782241306.994085:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 228 00000100:00100000:3.0:1782241306.994095:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+65:12464:x1868815120042496:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241306.994130:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241306.994150:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a636 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505467 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994218:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a63d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994234:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a63d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994246:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a63d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994257:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a644 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994264:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a644 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994271:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a644 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994361:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a64b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994370:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a64b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994377:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a64b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241306.994429:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1782241306.994439:0:11191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782241306.994461:0:11191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a64b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994473:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a64b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994481:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a63d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994487:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a63d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994493:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a63d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994511:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241306.994516:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a63d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994523:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a63d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994535:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:3.0:1782241306.994538:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241306.994543:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a63d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994549:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a63d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994562:0:11191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a644 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994577:0:11191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a644 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994584:0:11191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a644 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994590:0:11191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241306.994593:0:11191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a644 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994600:0:11191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a644 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994609:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890e81fbc000) 00010000:00010000:3.0:1782241306.994611:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241306.994614:0:11191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a644 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994619:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a644 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994646:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a636 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505467 expref: 67 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994659:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a64b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505467 expref: 66 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241306.994666:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:3.0:1782241306.994668:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782241306.994677:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164da00, rc 0) 00000100:00100000:3.0:1782241306.994747:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:12464:x1868815120042496:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 652us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241306.994803:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 228 00000100:00100000:3.0:1782241307.002144:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.002254:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120042624 00000100:00100000:2.0:1782241307.002265:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120042624 00000100:00100000:2.0:1782241307.002406:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:2.0:1782241307.002417:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:2399:x1868815120042624:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241307.002433:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241307.002458:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164da00/0xc9959f2fb1e1a64b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505467 expref: 66 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.002475:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:2.0:1782241307.002490:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241307.002561:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+65:2399:x1868815120042624:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 146us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241307.002569:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00080000:0.0:1782241307.002984:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241307.004235:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241307.004309:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120042880 00000100:00100000:3.0:1782241307.004316:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120042880 00000100:00100000:3.0:1782241307.004400:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 229 00000100:00100000:3.0:1782241307.004409:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+65:12464:x1868815120042880:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241307.004429:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241307.004445:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a652 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350546e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.004571:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a659 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.004585:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505459 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.004593:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a659 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.004627:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505459 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.004641:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505459 expref: 66 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241307.004654:0:6512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1868815140014592:192.168.204.58@tcp:104: 00000100:00100000:3.0:1782241307.004797:0:6512:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85240 going to sleep for 11 seconds 00000100:00100000:2.0:1782241307.011454:0:6512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1868815140014592:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241307.011483:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a659 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241307.011909:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.012363:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120043008 00000100:00100000:2.0:1782241307.012370:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120043008 00010000:00010000:2.0:1782241307.012408:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505459 expref: 67 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241307.012455:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 99 00000100:00100000:2.0:1782241307.012464:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e436c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+67:2398:x1868815120043008:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241307.012478:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241307.012485:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505459 expref: 67 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.012626:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505459 expref: 67 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.012649:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a621 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505459 expref: 67 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.012663:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:2.0:1782241307.012667:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a659 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.012752:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a659 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.012845:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a659 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.012875:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241307.012929:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e436c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:2398:x1868815120043008:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 465us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241307.012937:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 99 00010000:00010000:3.0:1782241307.014076:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a659 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.014087:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a659 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241307.014108:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1782241307.014244:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a652 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350546e expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.014261:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a659 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350546e expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.014270:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:3.0:1782241307.014273:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782241307.014276:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d800, rc 0) 00000100:00100000:3.0:1782241307.014397:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:12464:x1868815120042880:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 9988us (10166us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1782241307.014406:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 229 00000100:00100000:3.0:1782241307.020327:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241307.020435:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120043264 00000100:00100000:1.0:1782241307.020445:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120043264 00000100:00100000:1.0:1782241307.020592:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:1.0:1782241307.020603:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:12464:x1868815120043264:12345-192.168.204.58@tcp:103:lfs.0 00010000:00010000:1.0:1782241307.020619:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241307.020646:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1a5aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350543d expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.020664:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:1.0:1782241307.020670:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241307.020730:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+65:12464:x1868815120043264:12345-192.168.204.58@tcp:103:lfs.0 Request processed in 128us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241307.020753:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:2.0:1782241307.030355:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241307.030556:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120043392 00000100:00100000:0.0:1782241307.030568:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120043392 00000100:00100000:0.0:1782241307.030671:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 230 00000100:00100000:0.0:1782241307.030680:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e48939c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+65:12464:x1868815120043392:12345-192.168.204.58@tcp:58:lfs.0 00010000:00010000:0.0:1782241307.030851:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a667 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.030869:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a667 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.030880:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a667 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782241307.031000:0:10147:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1782241307.031377:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e48939c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+65:12464:x1868815120043392:12345-192.168.204.58@tcp:58:lfs.0 Request processed in 697us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241307.031414:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 230 00000100:00100000:0.0:1782241307.037112:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.037510:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120043520 00000100:00100000:2.0:1782241307.037521:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120043520 00000100:00100000:2.0:1782241307.037582:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 231 00000100:00100000:2.0:1782241307.037591:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+65:12464:x1868815120043520:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241307.037611:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241307.037632:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a66e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505475 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.037684:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a667 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.037695:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a66e lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505475 expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.037712:0:6510:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a667 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.038058:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a66e lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505475 expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.038073:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:2.0:1782241307.038076:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782241307.038079:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a66e lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505475 expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.038087:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad200, rc 0) 00000100:00100000:2.0:1782241307.038155:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:12464:x1868815120043520:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 565us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241307.038163:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 231 00010000:00010000:2.0:1782241307.269873:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241307.397430:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241307.397457:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140014720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241307.397549:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241307.400007:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140014720 00000100:00100000:1.0:1782241307.400027:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140014720 00000100:00100000:1.0:1782241307.400098:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1782241307.400109:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140014720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241307.400148:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241307.400246:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140014720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (2697us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241307.400255:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1782241307.400301:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140014720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241307.402843:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782241307.402874:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140014848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241307.402946:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241307.403782:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140014848 00000100:00100000:0.0:1782241307.403793:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140014848 00000100:00100000:0.0:1782241307.403855:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1782241307.403864:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7daed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140014848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241307.403891:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782241307.403992:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7daed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140014848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241307.403999:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1782241307.404379:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140014848:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1782241307.652968:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782241307.652978:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782241307.653021:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1782241307.653037:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782241307.653180:0:13782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1868815140014976:192.168.204.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782241307.653639:0:13782:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810900 going to sleep for 11 seconds 00000100:00100000:2.0:1782241307.656539:0:13782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1868815140014976:192.168.204.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782241307.664811:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.666331:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120043648 00000100:00100000:2.0:1782241307.666344:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120043648 00000100:00100000:2.0:1782241307.666417:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 232 00000100:00100000:2.0:1782241307.666426:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:12466:x1868815120043648:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782241307.666460:0:6512:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782241307.666587:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48202a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:12466:x1868815120043648:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 Request processed in 162us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241307.666595:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 232 00000100:00100000:0.0:1782241307.673292:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.673753:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120043776 00000100:00100000:2.0:1782241307.673809:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120043776 00000100:00100000:2.0:1782241307.673917:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 233 00000100:00100000:2.0:1782241307.673927:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:12466:x1868815120043776:12345-192.168.204.58@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1782241307.674005:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a675 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674022:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a675 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674034:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a675 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674051:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a67c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674058:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a67c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674066:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a67c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674099:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a683 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674109:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674115:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241307.674161:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1782241307.674166:0:10147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782241307.674185:0:10147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674197:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a675 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674203:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a675 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674210:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a675 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674216:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43face00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241307.674220:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a675 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674228:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a675 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674241:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890e81fbc300) 00010000:00010000:2.0:1782241307.674244:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241307.674249:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a675 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674255:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a675 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674269:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a67c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674275:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a67c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674281:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a67c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674291:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241307.674294:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a67c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674300:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a67c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674307:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff890e4bb38b00) 00010000:00010000:2.0:1782241307.674309:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241307.674312:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a67c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674317:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a67c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674329:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674334:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a683 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674339:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a683 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674344:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43faca00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241307.674347:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a683 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674352:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a683 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674366:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:2.0:1782241307.674368:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241307.674371:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a683 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.674376:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a683 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241307.674449:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:12466:x1868815120043776:12345-192.168.204.58@tcp:34:lhsmtool_posix.0 Request processed in 522us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241307.674457:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 233 00000100:00100000:1.0:1782241307.687581:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.687668:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120044032 00000100:00100000:2.0:1782241307.687678:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120044032 00000100:00100000:2.0:1782241307.687733:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 234 00000100:00100000:2.0:1782241307.687743:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+66:12466:x1868815120044032:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782241307.687790:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241307.687811:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a68a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350547c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.687919:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a691 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.687933:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a691 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.687946:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a691 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241307.687958:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1782241307.688051:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a691 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.688059:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a691 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.688065:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a691 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.688071:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241307.688075:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a691 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.688082:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a691 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.688093:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:2.0:1782241307.688096:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782241307.688100:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a691 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.688105:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a691 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.688144:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a68a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350547c expref: 68 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.688153:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890e81fbc300) 00010000:00010000:2.0:1782241307.688155:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782241307.688159:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a68a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350547c expref: 68 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.688179:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43faca00, rc 0) 00000100:00100000:2.0:1782241307.688239:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+67:12466:x1868815120044032:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 497us (669us total) trans 4294967507 rc 301/301 00000100:00100000:2.0:1782241307.688247:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 234 00000100:00100000:3.0:1782241307.693934:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241307.694116:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120044160 00000100:00100000:0.0:1782241307.694126:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120044160 00000100:00100000:0.0:1782241307.694185:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 235 00000100:00100000:0.0:1782241307.694207:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+67:12466:x1868815120044160:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782241307.694245:0:11191:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782241307.694356:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+67:12466:x1868815120044160:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 Request processed in 162us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241307.694364:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 235 00000100:00100000:0.0:1782241307.704635:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.706407:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120044416 00000100:00100000:2.0:1782241307.706420:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120044416 00000100:00100000:2.0:1782241307.706511:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 236 00000100:00100000:2.0:1782241307.706521:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+67:12466:x1868815120044416:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782241307.706543:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241307.706545:0:10147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782241307.706571:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eae00/0xc9959f2fb1e1a62f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505460 expref: 67 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.706590:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:2.0:1782241307.706595:0:10147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241307.706609:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a69f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505483 expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782241307.707047:0:10147:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1782241307.707192:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a6a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.707205:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.707215:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.707283:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a69f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505483 expref: 69 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.707298:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505483 expref: 68 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.707306:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff890e4bb38b00) 00010000:00010000:2.0:1782241307.707308:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241307.707310:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad400, rc 0) 00000100:00100000:2.0:1782241307.707390:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+68:12466:x1868815120044416:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 871us (2771us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1782241307.707399:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 236 00000100:00100000:3.0:1782241307.729895:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.730014:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120044672 00000100:00100000:2.0:1782241307.730025:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120044672 00000100:00100000:2.0:1782241307.730079:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 237 00000100:00100000:2.0:1782241307.730090:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+68:12466:x1868815120044672:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782241307.730155:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241307.730183:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1a6a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505483 expref: 68 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730202:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff890e4bb38b00) 00010000:00010000:2.0:1782241307.730214:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241307.730238:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a6b4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730252:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a6b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730278:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a6b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730293:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a6bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xd5e1a237 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730299:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a6bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd5e1a237 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730305:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a6bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd5e1a237 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730349:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a6b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730356:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a6b4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730362:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a6b4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730367:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43faca00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241307.730371:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a6b4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730377:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a6b4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730384:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:2.0:1782241307.730387:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241307.730390:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a6b4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730403:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1a6b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730412:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a6bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd5e1a237 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730418:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a6bb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd5e1a237 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730422:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a6bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd5e1a237 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730427:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43face00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241307.730429:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a6bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd5e1a237 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730434:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a6bb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd5e1a237 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730441:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xd5e1a237 (ffff890e4bb38e00) 00010000:00010000:2.0:1782241307.730443:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241307.730446:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a6bb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd5e1a237 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.730451:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1a6bb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd5e1a237 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241307.730548:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48202300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+67:12466:x1868815120044672:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 458us (662us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782241307.730555:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 237 00000100:00100000:1.0:1782241307.733130:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.733722:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120044800 00000100:00100000:2.0:1782241307.733733:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120044800 00000100:00100000:2.0:1782241307.733815:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 238 00000100:00100000:2.0:1782241307.733827:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+67:12466:x1868815120044800:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782241307.733847:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241307.733870:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a6c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350548a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.733908:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a6c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.733922:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.733933:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.734046:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fadc00/0xc9959f2fb1e1a6c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350548a expref: 69 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.734064:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350548a expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.734072:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff890e4bb38a00) 00010000:00010000:2.0:1782241307.734075:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782241307.734078:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861000, rc 0) 00000100:00100000:2.0:1782241307.734142:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+68:12466:x1868815120044800:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 318us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241307.734150:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 238 00000100:00100000:3.0:1782241307.738973:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.739169:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120045056 00000100:00100000:2.0:1782241307.739180:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120045056 00000100:00100000:2.0:1782241307.739247:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 239 00000100:00100000:2.0:1782241307.739258:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+68:12466:x1868815120045056:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782241307.739350:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1a6d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.739366:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1a6d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.739378:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1a6d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782241307.739556:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:2.0:1782241307.739610:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000033a2d73 reply state 0000000053e680f1 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1a6d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.739623:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1a6d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.739630:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff890e4bb38a00) 00010000:00010000:2.0:1782241307.739633:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1782241307.739637:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782241307.740196:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+70:12466:x1868815120045056:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 937us (1229us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1782241307.740205:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 239 00000100:00100000:3.0:1782241307.742793:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241307.743000:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120045184 00000100:00100000:0.0:1782241307.743011:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120045184 00000100:00100000:0.0:1782241307.743116:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 240 00000100:00100000:0.0:1782241307.743127:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+70:12466:x1868815120045184:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782241307.743155:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241307.743174:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a6d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505491 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.743243:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a6d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505491 expref: 71 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.743262:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a6d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505491 expref: 71 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.743282:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff890e4bb38a00) 00010000:00010000:0.0:1782241307.743286:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782241307.743289:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0000, rc 0) 00000100:00100000:0.0:1782241307.743348:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+71:12466:x1868815120045184:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 222us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241307.743356:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 240 00000100:00100000:1.0:1782241307.749077:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.749151:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120045312 00000100:00100000:2.0:1782241307.749162:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120045312 00000100:00100000:2.0:1782241307.749426:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 71 00000100:00100000:2.0:1782241307.749919:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2396:x1868815120045312:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1782241307.750161:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+10:2396:x1868815120045312:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 Request processed in 246us (1092us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1782241307.750171:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 71 00000100:00080000:1.0:1782241307.750468:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782241307.759718:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241307.759925:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120045568 00000100:00100000:1.0:1782241307.759936:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120045568 00000100:00100000:1.0:1782241307.759999:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 60 00000100:00100000:1.0:1782241307.760010:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+71:12466:x1868815120045568:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782241307.760246:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+72:12466:x1868815120045568:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 237us (536us total) trans 4294967510 rc 0/0 00000100:00100000:1.0:1782241307.760255:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 60 00000100:00100000:3.0:1782241307.765876:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241307.766005:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120045824 00000100:00100000:0.0:1782241307.766016:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120045824 00000100:00100000:0.0:1782241307.766078:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 241 00000100:00100000:0.0:1782241307.766089:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+72:12466:x1868815120045824:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782241307.766226:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+72:12466:x1868815120045824:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 138us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241307.766251:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 241 00000100:00100000:3.0:1782241307.772298:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.772503:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120045952 00000100:00100000:2.0:1782241307.772514:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120045952 00000100:00100000:2.0:1782241307.772579:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 242 00000100:00100000:2.0:1782241307.772590:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+72:12466:x1868815120045952:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782241307.772610:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241307.772630:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1a6de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505498 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.772701:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e1a6e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.772714:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e1a6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.772725:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e1a6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241307.772813:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782241307.772911:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e1a6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.772951:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1a6de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505498 expref: 74 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.772969:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e1a6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505498 expref: 73 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.772978:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff890e4bb38a00) 00010000:00010000:3.0:1782241307.772980:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782241307.772984:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860400, rc 0) 00000100:00100000:3.0:1782241307.773144:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+73:12466:x1868815120045952:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 552us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241307.773152:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 242 00000100:00100000:1.0:1782241307.781265:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.781369:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120046080 00000100:00100000:2.0:1782241307.781379:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120046080 00000100:00100000:2.0:1782241307.781475:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 72 00000100:00100000:2.0:1782241307.781495:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+10:2396:x1868815120046080:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782241307.781514:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241307.781534:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1a6ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350549f expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782241307.781577:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3ad81c, blocks: 0x0 00010000:00010000:2.0:1782241307.781596:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=371s v=(0 0) 00010000:00010000:2.0:1782241307.781600:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241307.781610:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1a6ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350549f expref: 11 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.781628:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1a6ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350549f expref: 11 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.781640:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b860800, rc 0) 00000100:00100000:2.0:1782241307.782024:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:2396:x1868815120046080:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 538us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241307.782031:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 72 00000100:00100000:0.0:1782241307.785654:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241307.786001:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120046336 00000100:00100000:3.0:1782241307.786011:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120046336 00000100:00100000:3.0:1782241307.786071:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 243 00000100:00100000:3.0:1782241307.786082:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+73:12466:x1868815120046336:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782241307.786201:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+73:12466:x1868815120046336:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 120us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241307.786209:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 243 00000100:00100000:3.0:1782241307.792891:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241307.793080:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120046464 00000100:00100000:1.0:1782241307.793089:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120046464 00000100:00100000:1.0:1782241307.793160:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 73 00000100:00100000:1.0:1782241307.793170:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:12466:x1868815120046464:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782241307.793189:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241307.793207:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bfcc7c9/0xc9959f2fb1e1a6f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335054a6 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.793250:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1a6ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350549f expref: 12 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.793260:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241307.793264:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241307.793268:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bfcc7c9/0xc9959f2fb1e1a6f3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054a6 expref: 12 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.793302:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1a6ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350549f expref: 12 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.793314:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1a6ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350549f expref: 12 pid: 8425 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241307.793327:0:8423:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1868815140015104:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241307.793434:0:8423:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afd540 going to sleep for 11 seconds 00000100:00100000:2.0:1782241307.798138:0:8423:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1868815140015104:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241307.798178:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004bfcc7c9/0xc9959f2fb1e1a6f3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054a6 expref: 12 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.798200:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea800, rc 0) 00000100:00100000:2.0:1782241307.798322:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+12:12466:x1868815120046464:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 5152us (5439us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241307.798331:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 73 00000100:00100000:0.0:1782241307.800924:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241307.801137:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120046592 00000100:00100000:1.0:1782241307.801147:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120046592 00010000:00010000:1.0:1782241307.801187:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1a6ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350549f expref: 12 pid: 8425 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241307.801248:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 100 00000100:00100000:1.0:1782241307.801258:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+12:2399:x1868815120046592:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241307.801274:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241307.801296:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1a6ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350549f expref: 12 pid: 8425 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.801310:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1a6ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350549f expref: 12 pid: 8425 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.801335:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1a6ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350549f expref: 12 pid: 8425 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.801352:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241307.801356:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241307.801364:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004bfcc7c9/0xc9959f2fb1e1a6f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054a6 expref: 11 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.801373:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bfcc7c9/0xc9959f2fb1e1a6f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054a6 expref: 11 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.801410:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004bfcc7c9/0xc9959f2fb1e1a6f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054a6 expref: 11 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241307.801424:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6496:1868815140015232:192.168.204.58@tcp:105: 00000100:00100000:1.0:1782241307.801529:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afd540 going to sleep for 11 seconds 00000100:00100000:1.0:1782241307.813152:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6496:1868815140015232:192.168.204.58@tcp:105: 00010000:00010000:1.0:1782241307.813180:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241307.813230:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:2399:x1868815120046592:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 11972us (12322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241307.813253:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 100 00000100:00100000:3.0:1782241307.817838:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241307.819130:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120046720 00000100:00100000:0.0:1782241307.819143:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120046720 00002000:00100000:0.0:1782241307.819199:0:8429:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff890d48203800 x1868815120046720/t0(0) o4->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:398/0 lens 504/0 e 0 to 0 dl 1782241318 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782241307.819211:0:8429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d48203800 with x1868815120046720 ext(0->12) 00002000:00010000:0.0:1782241307.819216:0:8429:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff890d48203800 00000100:00100000:0.0:1782241307.819255:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:0.0:1782241307.819265:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+11:2398:x1868815120046720:12345-192.168.204.58@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1782241307.820635:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+13:2398:x1868815120046720:12345-192.168.204.58@tcp:4:lhsmtool_posix.0 Request processed in 1363us (2797us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1782241307.820647:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 7 00002000:00100000:0.0:1782241307.820657:0:8429:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff890d48203800 x1868815120046720/t4294967321(0) o4->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:398/0 lens 504/448 e 0 to 0 dl 1782241318 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782241307.820675:0:8429:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d48203800 with x1868815120046720 ext(0->12) 00002000:00010000:0.0:1782241307.820680:0:8429:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff890d48203800 00000100:00100000:0.0:1782241307.824508:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.824622:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120046848 00000100:00100000:2.0:1782241307.824632:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120046848 00000100:00100000:2.0:1782241307.824699:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 244 00000100:00100000:2.0:1782241307.824722:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+73:12466:x1868815120046848:12345-192.168.204.58@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1782241307.830832:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967510 is committed 00000004:00080000:0.0:1782241307.830871:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1782241307.830900:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1782241307.830920:0:6489:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff890e49419e40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1782241307.830925:0:6489:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e77961100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff890e77a28300 00000020:00080000:0.0:1782241307.830946:0:6489:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e77961900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff890d478f1a00 00000020:00080000:0.0:1782241307.830999:0:6489:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff890e77982a80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1782241307.831002:0:6489:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e7d533800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff890e77982780 00000020:00080000:0.0:1782241307.831005:0:6489:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e7d533200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff890d418b9000 00000020:00080000:0.0:1782241307.831029:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1782241307.831089:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1782241307.831353:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241307.831374:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140015360:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782241307.831434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241307.831498:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140015360 00000100:00100000:1.0:1782241307.831506:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140015360 00000100:00100000:1.0:1782241307.831552:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782241307.831561:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815140015360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782241307.831586:0:8747:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:1.0:1782241307.831616:0:8747:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a3ad81a, atime: 0x0, ctime: 0x6a3ad81a, blocks: 0x8 00010000:00010000:1.0:1782241307.831623:0:8747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a4baf95/0xc9959f2fb1e1a6fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.831639:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1782241307.831643:0:8747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241307.831649:0:8747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a4baf95/0xc9959f2fb1e1a6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.831664:0:8747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a4baf95/0xc9959f2fb1e1a6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.831674:0:8747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a4baf95/0xc9959f2fb1e1a6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.831689:0:8747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a4baf95/0xc9959f2fb1e1a6fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.831715:0:8747:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782241307.831882:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3639:x1868815140015360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 321us (447us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1782241307.831890:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:1.0:1782241307.831932:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890d4881f100/2, rc 0, transno 4294967311 00000100:00100000:1.0:1782241307.831938:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140015360:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782241307.832154:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241307.832162:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a4baf95/0xc9959f2fb1e1a6fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.832169:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241307.832173:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a4baf95/0xc9959f2fb1e1a6fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.832181:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a4baf95/0xc9959f2fb1e1a6fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.832198:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a4baf95/0xc9959f2fb1e1a6fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.832206:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a4baf95/0xc9959f2fb1e1a6fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.832225:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241307.832227:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241307.832228:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241307.832235:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782241307.832245:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140015488:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782241307.832276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241307.832532:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e1a3f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832540:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e1a3f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832546:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e1a3f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832552:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164dc00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241307.832556:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e1a3f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832561:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e1a3f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832571:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff890d4195bc00) 00010000:00010000:2.0:1782241307.832574:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241307.832577:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e1a3f8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832582:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164dc00/0xc9959f2fb1e1a3f8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832602:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e1a4a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832608:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e1a4a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832614:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e1a4a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832628:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241307.832632:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e1a4a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832637:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e1a4a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832646:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff890e81fbc200) 00010000:00010000:2.0:1782241307.832648:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241307.832652:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e1a4a0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832657:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac000/0xc9959f2fb1e1a4a0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832685:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a51e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832692:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a51e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832706:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a51e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832712:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241307.832715:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a51e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832720:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a51e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832738:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890e81fbc000) 00010000:00010000:2.0:1782241307.832741:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241307.832744:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a51e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832749:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea400/0xc9959f2fb1e1a51e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832816:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a541 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832823:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a541 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832828:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a541 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.832833:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241307.832836:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a541 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241307.833088:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+24:12466:x1868815120046848:12345-192.168.204.58@tcp:44:lhsmtool_posix.0 Request processed in 8365us (8586us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241307.833108:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 244 00000100:00100000:3.0:1782241307.833145:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140015488 00000100:00100000:3.0:1782241307.833150:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140015488 00000100:00100000:3.0:1782241307.833195:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782241307.833204:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48203480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815140015488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782241307.833223:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:3.0:1782241307.833245:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a701 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.833260:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e95febcd/0xc9959f2fb1e1a4ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053fe expref: 12 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.833268:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1782241307.833271:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782241307.833275:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a701 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.833301:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e95febcd/0xc9959f2fb1e1a4ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053fe expref: 12 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.833314:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e95febcd/0xc9959f2fb1e1a4ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053fe expref: 12 pid: 8423 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241307.833325:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8426:1868815140015616:192.168.204.58@tcp:104: 00000100:00100000:3.0:1782241307.833365:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1782241307.833416:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a541 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.833431:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890e81fbc000) 00010000:00010000:2.0:1782241307.833434:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241307.833438:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a541 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.833444:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1a541 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.833498:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a613 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.833505:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a613 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.833512:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a613 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.833518:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241307.833521:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a613 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.833528:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a613 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.833536:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:2.0:1782241307.833539:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241307.833542:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a613 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.833547:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea000/0xc9959f2fb1e1a613 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.833559:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1a6d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.833565:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1a6d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.833571:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1a6d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.833582:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241307.833585:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1a6d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.833590:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1a6d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.833598:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff890e4bb38a00) 00010000:00010000:2.0:1782241307.833600:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782241307.833603:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1a6d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.833608:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1a6d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782241307.836075:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782241307.844103:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8426:1868815140015616:192.168.204.58@tcp:104: 00010000:00010000:0.0:1782241307.844138:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a701 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241307.851031:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241307.851102:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.851197:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120046976 00000100:00100000:2.0:1782241307.851207:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120046976 00000100:00100000:2.0:1782241307.851266:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 76 00000100:00100000:2.0:1782241307.851276:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+13:2399:x1868815120046976:12345-192.168.204.58@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1782241307.851529:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120047104 00000100:00100000:1.0:1782241307.851535:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120047104 00010000:00010000:1.0:1782241307.851560:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e95febcd/0xc9959f2fb1e1a4ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053fe expref: 14 pid: 8423 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241307.851595:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 101 00000100:00100000:1.0:1782241307.851603:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+14:2399:x1868815120047104:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241307.851613:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241307.851619:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e95febcd/0xc9959f2fb1e1a4ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053fe expref: 14 pid: 8423 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.851632:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e95febcd/0xc9959f2fb1e1a4ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053fe expref: 14 pid: 8423 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.851677:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e95febcd/0xc9959f2fb1e1a4ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053fe expref: 14 pid: 8423 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.851709:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782241307.851713:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782241307.851719:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.851729:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a701 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.851800:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241307.851853:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+13:2399:x1868815120047104:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 250us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241307.851861:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 101 00010000:00010000:1.0:1782241307.851887:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.851897:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.851908:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.851915:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.851941:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782241307.852109:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48203480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3638:x1868815140015488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18905us (19831us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1782241307.852118:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:1.0:1782241307.852168:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890d48202680/2, rc 0, transno 4294967322 00000100:00100000:1.0:1782241307.852180:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48202680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140015488:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1782241307.852719:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241307.852727:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.852737:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241307.852742:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.852752:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a701 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.852797:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a701 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.852806:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f97acc2f/0xc9959f2fb1e1a701 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.852825:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241307.852826:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241307.852828:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782241307.870106:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1782241307.870122:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:2.0:1782241307.871222:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2399:x1868815120046976:12345-192.168.204.58@tcp:16:lhsmtool_posix.0 Request processed in 19938us (20193us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241307.871236:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 76 00000100:00100000:0.0:1782241307.883119:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241307.883275:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120047360 00000100:00100000:3.0:1782241307.883285:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120047360 00000100:00100000:3.0:1782241307.883347:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 245 00000100:00100000:3.0:1782241307.883357:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:12466:x1868815120047360:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782241307.883423:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241307.883452:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e1a6e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505498 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.883474:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff890e4bb38a00) 00010000:00010000:3.0:1782241307.883479:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782241307.883520:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a708 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.883532:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a708 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.883541:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a708 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782241307.883658:0:6510:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000065f66d5b reply state 00000000d82eb481 transno 4294967511 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a708 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.883684:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a708 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.883690:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff890e4bb38a00) 00010000:00010000:3.0:1782241307.883693:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782241307.883696:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782241307.883849:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:12466:x1868815120047360:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 487us (733us total) trans 4294967511 rc 0/0 00000100:00100000:3.0:1782241307.883881:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 245 00000100:00100000:3.0:1782241307.888571:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241307.888657:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120047488 00000100:00100000:1.0:1782241307.888675:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120047488 00000100:00100000:1.0:1782241307.888729:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 77 00000100:00100000:1.0:1782241307.888739:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2398:x1868815120047488:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1782241307.889141:0:8746:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1782241307.889145:0:8746:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1782241307 00002000:00010000:1.0:1782241307.889148:0:8746:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1782241306 00002000:00010000:1.0:1782241307.889150:0:8746:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1782241308 -> 1782241307 00002000:00010000:1.0:1782241307.889152:0:8746:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1782241307.889213:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2398:x1868815120047488:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 Request processed in 474us (649us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1782241307.889221:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 77 00000100:00100000:2.0:1782241307.895701:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241307.896502:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120047744 00000100:00100000:0.0:1782241307.896512:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120047744 00000100:00100000:0.0:1782241307.896575:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 246 00000100:00100000:0.0:1782241307.896584:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:12466:x1868815120047744:12345-192.168.204.58@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1782241307.896667:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a70f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.896684:0:10147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a6c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350548a expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.896694:0:10147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a70f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.896741:0:10147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350548a expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.896795:0:10147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350548a expref: 22 pid: 6511 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241307.896814:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140015744:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241307.897252:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46810240 going to sleep for 11 seconds 00000100:00100000:2.0:1782241307.903398:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140015744:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241307.903427:0:10147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a70f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241307.904001:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241307.904632:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120047872 00000100:00100000:0.0:1782241307.904640:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120047872 00010000:00010000:0.0:1782241307.904691:0:10331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350548a expref: 23 pid: 6511 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241307.904730:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 102 00000100:00100000:0.0:1782241307.904739:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+23:2398:x1868815120047872:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241307.904788:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241307.904797:0:10331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350548a expref: 23 pid: 6511 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.904809:0:10331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350548a expref: 23 pid: 6511 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.904830:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a6c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350548a expref: 23 pid: 6511 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.904846:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff890e4bb38a00) 00010000:00010000:0.0:1782241307.904864:0:10331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a70f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.904873:0:10331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a70f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.904879:0:10331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a70f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.904918:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241307.904969:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:2398:x1868815120047872:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 231us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241307.904978:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 102 00010000:00010000:3.0:1782241307.905040:0:10147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a70f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.905048:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a70f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.905103:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a70f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.905111:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a70f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.905117:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a70f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.905122:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241307.905127:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a70f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.905133:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a70f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.905143:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff890e4bb38a00) 00010000:00010000:3.0:1782241307.905146:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1782241307.905150:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a70f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.905157:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1400/0xc9959f2fb1e1a70f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241307.905211:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:12466:x1868815120047744:12345-192.168.204.58@tcp:55:lhsmtool_posix.0 Request processed in 8627us (9519us total) trans 0 rc -22/-22 00000100:00100000:3.0:1782241307.905219:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 246 00000100:00100000:0.0:1782241307.919269:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241307.919555:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120048000 00000100:00100000:1.0:1782241307.919565:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120048000 00000100:00100000:1.0:1782241307.919622:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 78 00000100:00100000:1.0:1782241307.919631:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2399:x1868815120048000:12345-192.168.204.58@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782241307.919686:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e3340d7e/0xc9959f2fb1e1a716 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.919725:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004bfcc7c9/0xc9959f2fb1e1a6f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054a6 expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.919733:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241307.919738:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782241307.919742:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3340d7e/0xc9959f2fb1e1a716 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.919807:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004bfcc7c9/0xc9959f2fb1e1a6f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054a6 expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241307.919821:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004bfcc7c9/0xc9959f2fb1e1a6f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054a6 expref: 8 pid: 8423 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241307.919835:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8426:1868815140015872:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241307.919909:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47afd240 going to sleep for 11 seconds 00000100:00100000:1.0:1782241307.926330:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.926436:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120048128 00000100:00100000:2.0:1782241307.926446:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120048128 00010000:00010000:2.0:1782241307.926492:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004bfcc7c9/0xc9959f2fb1e1a6f3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054a6 expref: 9 pid: 8423 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241307.926533:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 103 00000100:00100000:2.0:1782241307.926542:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2399:x1868815120048128:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241307.926574:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241307.926597:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004bfcc7c9/0xc9959f2fb1e1a6f3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054a6 expref: 9 pid: 8423 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.926610:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004bfcc7c9/0xc9959f2fb1e1a6f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054a6 expref: 9 pid: 8423 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.926637:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782241307.926642:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782241307.926648:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3340d7e/0xc9959f2fb1e1a716 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.926659:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3340d7e/0xc9959f2fb1e1a716 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.926689:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241307.926746:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+9:2399:x1868815120048128:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 204us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241307.926780:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 103 00010000:00010000:0.0:1782241307.929127:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bfcc7c9/0xc9959f2fb1e1a6f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054a6 expref: 8 pid: 8423 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241307.929150:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8426:1868815140015872:192.168.204.58@tcp:104: 00010000:00010000:0.0:1782241307.929175:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e3340d7e/0xc9959f2fb1e1a716 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.929186:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e3340d7e/0xc9959f2fb1e1a716 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.929192:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3340d7e/0xc9959f2fb1e1a716 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.929220:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e3340d7e/0xc9959f2fb1e1a716 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.929242:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3340d7e/0xc9959f2fb1e1a716 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.929250:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3340d7e/0xc9959f2fb1e1a716 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.929256:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241307.929260:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3340d7e/0xc9959f2fb1e1a716 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.929269:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3340d7e/0xc9959f2fb1e1a716 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.929287:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3340d7e/0xc9959f2fb1e1a716 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.929294:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3340d7e/0xc9959f2fb1e1a716 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241307.929382:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2399:x1868815120048000:12345-192.168.204.58@tcp:1:lhsmtool_posix.0 Request processed in 9751us (10122us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241307.929393:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 78 00000100:00100000:1.0:1782241307.940122:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241307.940307:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120048384 00000100:00100000:3.0:1782241307.940317:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120048384 00000100:00100000:3.0:1782241307.940377:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 247 00000100:00100000:3.0:1782241307.940387:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:12466:x1868815120048384:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782241307.940567:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a71d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.940585:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a60c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505452 expref: 21 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.940595:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a71d lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.940631:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a60c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505452 expref: 21 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.940645:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a60c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505452 expref: 21 pid: 10147 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241307.940670:0:6512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48203480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1868815140016000:192.168.204.58@tcp:104: 00000100:00100000:3.0:1782241307.940751:0:6512:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85300 going to sleep for 11 seconds 00000100:00100000:3.0:1782241307.948053:0:6512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48203480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1868815140016000:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241307.948084:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a71d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241307.953114:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.953682:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120048512 00000100:00100000:2.0:1782241307.953692:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120048512 00010000:00010000:2.0:1782241307.953735:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a60c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505452 expref: 22 pid: 10147 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241307.953815:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 104 00000100:00100000:2.0:1782241307.953825:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:2399:x1868815120048512:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241307.953859:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241307.953866:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a60c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505452 expref: 22 pid: 10147 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.953881:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a60c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505452 expref: 22 pid: 10147 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.953902:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad600/0xc9959f2fb1e1a60c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505452 expref: 22 pid: 10147 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.953918:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:2.0:1782241307.953924:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a66e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505475 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.953934:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a71d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.953943:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a71d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.953949:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a71d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.953974:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241307.954032:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:2399:x1868815120048512:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 208us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241307.954041:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 104 00010000:00010000:3.0:1782241307.954502:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a71d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.954512:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a71d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.954690:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a724 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.954703:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a6d7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505491 expref: 21 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.954710:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a724 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.954739:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a6d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505491 expref: 21 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.954752:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a6d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505491 expref: 21 pid: 11191 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241307.954798:0:6512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48203480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1868815140016128:192.168.204.58@tcp:104: 00000100:00100000:3.0:1782241307.954858:0:6512:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241307.967311:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241307.968010:0:6512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48203480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1868815140016128:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241307.968045:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a724 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241307.968999:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120048640 00000100:00100000:0.0:1782241307.969008:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120048640 00010000:00010000:0.0:1782241307.969052:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a6d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505491 expref: 22 pid: 11191 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241307.969138:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 105 00000100:00100000:0.0:1782241307.969148:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e436c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:2398:x1868815120048640:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241307.969163:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241307.969170:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a6d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505491 expref: 22 pid: 11191 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.969182:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a6d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505491 expref: 22 pid: 11191 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.969205:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f0000/0xc9959f2fb1e1a6d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505491 expref: 22 pid: 11191 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.969226:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff890e4bb38a00) 00010000:00010000:0.0:1782241307.969232:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a724 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.969242:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a724 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.969250:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a724 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241307.969277:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241307.969332:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e436c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:2398:x1868815120048640:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 184us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241307.969341:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 105 00010000:00010000:3.0:1782241307.969847:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a724 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.969863:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a724 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782241307.969971:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:3.0:1782241307.970073:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000001:00080000:3.0:1782241307.970117:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:3.0:1782241307.970193:0:6512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48203480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1868815140016256:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782241307.970243:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241307.970272:0:6512:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85900 going to sleep for 11 seconds 00000100:00100000:0.0:1782241307.972190:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140016256 00000100:00100000:0.0:1782241307.972218:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140016256 00000100:00100000:1.0:1782241307.973370:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1782241307.973387:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6512:x1868815140016256:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782241307.973534:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6512:x1868815140016256:12345-0@lo:1000:mdt00_002.0 Request processed in 153us (3290us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241307.973541:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1782241307.973634:0:6512:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1782241307.973649:0:6512:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1782241307.973681:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff890d48202680, transno 4294967322 00000100:00100000:2.0:1782241307.973704:0:6512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48203480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1868815140016256:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1782241307.973880:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00000100:00100000:2.0:1782241307.973971:0:6512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48836300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1868815140016384:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782241307.974012:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241307.974950:0:6512:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982780 going to sleep for 11 seconds 00000100:00100000:3.0:1782241307.975048:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140016384 00000100:00100000:3.0:1782241307.975056:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140016384 00000100:00100000:1.0:1782241307.976458:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1782241307.976471:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1868815140016384:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782241307.976670:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6512:x1868815140016384:12345-0@lo:1000:mdt00_002.0 Request processed in 191us (2648us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1782241307.976679:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1782241307.976940:0:6512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48836300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1868815140016384:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1782241307.976991:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a724 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.977003:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a724 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.977010:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a724 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.977017:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164ca00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241307.977021:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a724 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.977029:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a724 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.977046:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff890e4bb38a00) 00010000:00010000:2.0:1782241307.977049:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782241307.977054:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a724 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.977060:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a724 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.977308:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a667 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.977315:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a667 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.977321:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a667 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.977325:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1a00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241307.977328:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a667 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.977334:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a667 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.977342:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:2.0:1782241307.977345:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782241307.977353:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a66e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505475 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.977364:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a66e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505475 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.977373:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a66e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505475 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241307.977408:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a66e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505475 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241307.977436:0:6512:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48834700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1868815140016512:192.168.204.58@tcp:105: 00000100:00100000:2.0:1782241307.977532:0:6512:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77982780 going to sleep for 11 seconds 00000100:00100000:3.0:1782241307.983006:0:6512:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48834700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1868815140016512:192.168.204.58@tcp:105: 00010000:00010000:3.0:1782241307.983040:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a667 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983052:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1a00/0xc9959f2fb1e1a667 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983084:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a72b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983110:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a72b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983122:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a72b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983134:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a72b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983140:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a72b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983161:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a72b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983167:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164ca00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241307.983171:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a72b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983178:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a72b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983191:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:3.0:1782241307.983194:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241307.983198:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a72b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983203:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a72b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983212:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a71d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983218:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a71d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983224:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a71d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983229:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241307.983231:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a71d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983248:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a71d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983256:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:3.0:1782241307.983258:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782241307.983261:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a71d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241307.983267:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a71d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241307.983449:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+24:12466:x1868815120048384:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 43062us (43333us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1782241307.983460:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 247 00000020:00080000:3.0:1782241307.983467:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1782241307.983858:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782241307.983864:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782241307.984373:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1782241307.984383:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782241307.992962:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241307.993219:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120048768 00000100:00100000:2.0:1782241307.993230:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120048768 00000100:00100000:2.0:1782241307.993290:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 61 00000100:00100000:2.0:1782241307.993300:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+24:12464:x1868815120048768:12345-192.168.204.58@tcp:49:lfs.0 00000100:00100000:2.0:1782241307.993435:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+24:12464:x1868815120048768:12345-192.168.204.58@tcp:49:lfs.0 Request processed in 136us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241307.993442:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 61 00000100:00100000:1.0:1782241308.002867:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241308.003633:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120049024 00000100:00100000:2.0:1782241308.003644:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120049024 00000100:00100000:2.0:1782241308.003717:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 62 00000100:00100000:2.0:1782241308.003729:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47a48c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+24:12466:x1868815120049024:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1782241308.004082:0:6514:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1782241308.004646:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967517 00010000:00010000:2.0:1782241308.004696:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a732 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.004713:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a732 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.004724:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a732 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.004748:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a732 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.004775:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a732 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.004781:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a732 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.004849:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782241308.004951:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47a48c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+26:12466:x1868815120049024:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 1222us (2092us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1782241308.004960:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 62 00000020:00080000:2.0:1782241308.004965:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782241308.012883:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241308.012897:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a732 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241308.013165:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241308.013170:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a732 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241308.013182:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a732 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241308.013201:0:8441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff890e4bb38a00) 00010000:00010000:3.0:1782241308.013204:0:8441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782241308.013209:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a732 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241308.013237:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861000/0xc9959f2fb1e1a732 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241308.017573:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241308.018203:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120049280 00000100:00100000:0.0:1782241308.018212:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120049280 00000100:00100000:0.0:1782241308.018276:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 248 00000100:00100000:0.0:1782241308.018287:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+26:12464:x1868815120049280:12345-192.168.204.58@tcp:58:lfs.0 00000040:00080000:0.0:1782241308.018452:0:11191:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1782241308.019536:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+26:12464:x1868815120049280:12345-192.168.204.58@tcp:58:lfs.0 Request processed in 378us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241308.019548:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 248 00010000:00010000:2.0:1782241308.021974:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241308.021981:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241308.021984:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241308.091391:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241308.092229:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120049408 00000100:00100000:3.0:1782241308.092240:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120049408 00000100:00100000:2.0:1782241308.092855:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 249 00000100:00100000:2.0:1782241308.092867:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+26:12468:x1868815120049408:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241308.092886:0:10147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241308.093070:0:10147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1a739 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335054ad expref: -99 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.093332:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e1a740 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.093347:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e1a740 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.093373:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e1a740 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.093387:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1a747 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.093394:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1a747 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.093401:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1a747 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.093872:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1a74e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.093884:0:10147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a659 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350546e expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.093893:0:10147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1a74e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.094001:0:10147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a659 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350546e expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.094017:0:10147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a659 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350546e expref: 27 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241308.094030:0:10147:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48837480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140016640:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241308.094321:0:10147:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc2840 going to sleep for 11 seconds 00000100:00100000:2.0:1782241308.099392:0:10147:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48837480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10147:1868815140016640:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241308.099424:0:10147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1a74e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241308.102343:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241308.102846:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120049664 00000100:00100000:0.0:1782241308.102855:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120049664 00000100:00100000:0.0:1782241308.102922:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 63 00000100:00100000:0.0:1782241308.102932:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+28:6166:x1868815120049664:12345-192.168.204.58@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782241308.103149:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+29:6166:x1868815120049664:12345-192.168.204.58@tcp:35:ldlm_bl.0 Request processed in 216us (813us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1782241308.103157:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 63 00000100:00100000:1.0:1782241308.113006:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241308.113126:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120049792 00000100:00100000:2.0:1782241308.113137:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120049792 00010000:00010000:2.0:1782241308.113180:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a659 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350546e expref: 29 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241308.113223:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 106 00000100:00100000:2.0:1782241308.113233:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+29:2399:x1868815120049792:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241308.113249:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241308.113256:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a659 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350546e expref: 29 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.113269:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a659 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350546e expref: 29 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.113293:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1a659 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350546e expref: 29 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.113310:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:2.0:1782241308.113315:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1a74e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.113325:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1a74e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.113332:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1a74e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.113420:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241308.113494:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+28:2399:x1868815120049792:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 261us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241308.113502:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 106 00010000:00010000:3.0:1782241308.116144:0:10147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1a74e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241308.116159:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1a74e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241308.116370:0:10147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1782241308.116376:0:10147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782241308.116400:0:10147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1a74e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116416:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1a74e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116426:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e1a740 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116432:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e1a740 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116439:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e1a740 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116445:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241308.116449:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e1a740 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116457:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e1a740 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116471:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:2.0:1782241308.116474:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241308.116504:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e1a740 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116511:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860400/0xc9959f2fb1e1a740 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116527:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1a747 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116532:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1a747 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116538:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1a747 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116542:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241308.116545:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1a747 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116550:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1a747 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116557:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff890e4bb38900) 00010000:00010000:2.0:1782241308.116559:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241308.116562:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1a747 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116567:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860800/0xc9959f2fb1e1a747 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116621:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b860000/0xc9959f2fb1e1a739 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054ad expref: 28 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116646:0:10147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1a74e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054ad expref: 27 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241308.116652:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:2.0:1782241308.116655:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782241308.116657:0:10147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861e00, rc 0) 00000100:00100000:2.0:1782241308.116740:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:12468:x1868815120049408:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 23874us (25357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241308.116749:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 249 00010000:00010000:3.0:1782241308.296065:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241308.941567:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140016768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241308.941647:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241308.942040:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140016768 00000100:00100000:0.0:1782241308.942048:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140016768 00000100:00100000:0.0:1782241308.942147:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782241308.942156:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140016768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782241308.942184:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241308.942235:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140016768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241308.942241:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782241308.942518:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140016768:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1782241308.943226:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241308.945848:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782241308.945870:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140016896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782241308.945935:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241308.946001:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140016896 00000100:00100000:0.0:1782241308.946008:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140016896 00000100:00100000:0.0:1782241308.946074:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1782241308.946083:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1868815140016896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782241308.946106:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241308.946150:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1868815140016896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241308.946157:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:0.0:1782241308.946177:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241308.946213:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140016896:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1782241308.999865:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782241308.999875:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782241308.999900:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1782241308.999907:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782241309.000041:0:13782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1868815140017024:192.168.204.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782241309.000129:0:13782:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503a93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241309.009124:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241309.009194:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120049920 00000100:00100000:2.0:1782241309.009202:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120049920 00000100:00100000:2.0:1782241309.009270:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 250 00000100:00100000:2.0:1782241309.009280:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+28:12479:x1868815120049920:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782241309.009313:0:6512:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782241309.009411:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+28:12479:x1868815120049920:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 Request processed in 132us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241309.009418:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 250 00000100:00080000:1.0:1782241309.009559:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782241309.010020:0:13782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13782:1868815140017024:192.168.204.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782241309.023504:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241309.023697:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120050176 00000100:00100000:3.0:1782241309.023707:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120050176 00000100:00100000:3.0:1782241309.023800:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 251 00000100:00100000:3.0:1782241309.023810:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+27:12479:x1868815120050176:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782241309.023832:0:11191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241309.023851:0:11191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a755 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335054b4 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.023958:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a75c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.023983:0:11191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a75c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.023996:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a75c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241309.024009:0:11191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1782241309.024115:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d000/0xc9959f2fb1e1a755 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054b4 expref: 30 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.024129:0:11191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a75c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054b4 expref: 29 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.024137:0:11191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:3.0:1782241309.024140:0:11191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782241309.024144:0:11191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164ca00, rc 0) 00000100:00100000:3.0:1782241309.024203:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+29:12479:x1868815120050176:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 393us (708us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1782241309.024210:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 251 00000100:00100000:2.0:1782241309.035205:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241309.035280:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120050304 00000100:00100000:3.0:1782241309.035290:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120050304 00000100:00100000:3.0:1782241309.035381:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:3.0:1782241309.035391:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48837800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+29:2398:x1868815120050304:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241309.035407:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241309.035432:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a75c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054b4 expref: 29 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.035476:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:3.0:1782241309.035481:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241309.035535:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48837800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+28:2398:x1868815120050304:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 145us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241309.035543:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:3.0:1782241309.044438:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241309.044487:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120050560 00000100:00100000:3.0:1782241309.044497:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120050560 00000100:00100000:3.0:1782241309.044548:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 252 00000100:00100000:3.0:1782241309.044556:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+28:12479:x1868815120050560:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782241309.044632:0:10147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a76a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.044663:0:10147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a76a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.044677:0:10147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a76a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.044848:0:10147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a76a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.044856:0:10147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a76a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.044862:0:10147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a76a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.044868:0:10147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241309.044879:0:10147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a76a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.044886:0:10147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a76a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.044898:0:10147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:3.0:1782241309.044901:0:10147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782241309.044905:0:10147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a76a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.044911:0:10147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a76a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241309.045015:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+29:12479:x1868815120050560:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 458us (586us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1782241309.045023:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 252 00000040:00080000:3.0:1782241309.045204:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782241309.045208:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782241309.045693:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1782241309.045703:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782241309.049349:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241309.051436:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120050816 00000100:00100000:0.0:1782241309.051450:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120050816 00000100:00100000:0.0:1782241309.051653:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 64 00000100:00100000:0.0:1782241309.051665:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+29:12479:x1868815120050816:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782241309.051923:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+30:12479:x1868815120050816:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 260us (2582us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1782241309.051932:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 64 00000040:00080000:1.0:1782241309.098565:0:14664:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782241309.098575:0:14664:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782241309.098717:0:14664:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1782241309.098725:0:14664:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1782241309.329619:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241309.365176:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241309.365212:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120051072 00000100:00100000:3.0:1782241309.365221:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120051072 00000100:00100000:3.0:1782241309.365296:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 253 00000100:00100000:3.0:1782241309.365307:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+30:12492:x1868815120051072:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241309.365332:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241309.365352:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a771 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335054bb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.365491:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a778 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.365505:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a778 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.365517:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a778 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241309.365529:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1782241309.365642:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a771 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054bb expref: 33 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.369508:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a778 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054bb expref: 32 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241309.369527:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:3.0:1782241309.369530:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782241309.369534:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c800, rc 0) 00000100:00100000:3.0:1782241309.369634:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+32:12492:x1868815120051072:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 4327us (4466us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1782241309.369644:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 253 00000100:00100000:3.0:1782241309.385727:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241309.386187:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120051200 00000100:00100000:0.0:1782241309.386198:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120051200 00000100:00100000:0.0:1782241309.386256:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 254 00000100:00100000:0.0:1782241309.386264:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48202680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+32:12492:x1868815120051200:12345-192.168.204.58@tcp:54:lfs.0 00010000:00010000:0.0:1782241309.386340:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a786 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241309.386357:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a786 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241309.386368:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a786 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241309.386405:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a786 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241309.386411:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a786 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241309.386419:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a786 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241309.386424:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241309.386428:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a786 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241309.386435:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a786 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241309.386445:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:0.0:1782241309.386449:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782241309.386463:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a786 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241309.386469:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1000/0xc9959f2fb1e1a786 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241309.386687:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48202680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+32:12492:x1868815120051200:12345-192.168.204.58@tcp:54:lfs.0 Request processed in 422us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241309.386694:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 254 00000100:00100000:2.0:1782241309.518940:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241309.519527:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120051328 00000100:00100000:1.0:1782241309.519538:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120051328 00000100:00100000:1.0:1782241309.519729:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 79 00000100:00100000:1.0:1782241309.519740:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2397:x1868815120051328:12345-192.168.204.58@tcp:101:cat.0 00010000:00010000:1.0:1782241309.519809:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241309.519832:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a4baf95/0xc9959f2fb1e1a78d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335054c2 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782241309.520188:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a3ad81b, atime: 0x6a3ad81a, ctime: 0x6a3ad81b, blocks: 0x8 00010000:00010000:1.0:1782241309.520359:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=372s v=(0 0) 00010000:00010000:1.0:1782241309.520364:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241309.520374:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a4baf95/0xc9959f2fb1e1a78d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054c2 expref: 8 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241309.520405:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a4baf95/0xc9959f2fb1e1a78d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054c2 expref: 8 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241309.520416:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb200, rc 0) 00000100:00100000:1.0:1782241309.520490:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2397:x1868815120051328:12345-192.168.204.58@tcp:101:cat.0 Request processed in 752us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241309.520496:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 79 00000100:00080000:0.0:1782241309.522103:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782241309.526343:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241309.526526:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120051456 00000100:00100000:2.0:1782241309.526536:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120051456 00002000:00100000:2.0:1782241309.526598:0:8430:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff890d4836ce00 x1868815120051456/t0(0) o3->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:400/0 lens 488/0 e 0 to 0 dl 1782241320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782241309.526609:0:8430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d4836ce00 with x1868815120051456 ext(0->4095) 00002000:00010000:2.0:1782241309.526638:0:8430:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff890d4836ce00 00000100:00100000:2.0:1782241309.526676:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 8 00000100:00100000:2.0:1782241309.526686:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2397:x1868815120051456:12345-192.168.204.58@tcp:3:cat.0 00000100:00100000:2.0:1782241309.526916:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2397:x1868815120051456:12345-192.168.204.58@tcp:3:cat.0 Request processed in 231us (581us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1782241309.526925:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 8 00002000:00100000:2.0:1782241309.526932:0:8430:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff890d4836ce00 x1868815120051456/t0(0) o3->8052d7b9-50cc-405f-b8e0-5c9d863c1c52@192.168.204.58@tcp:400/0 lens 488/4536 e 0 to 0 dl 1782241320 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782241309.526940:0:8430:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d4836ce00 with x1868815120051456 ext(0->4095) 00002000:00010000:2.0:1782241309.526945:0:8430:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff890d4836ce00 00000100:00100000:3.0:1782241310.117376:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241310.117424:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241310.117482:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241310.117519:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241310.117519:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120051840 00000100:00100000:0.0:1782241310.117532:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120051840 00000100:00100000:3.0:1782241310.117551:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241310.117600:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241310.117602:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120052352 00000100:00100000:0.0:1782241310.117607:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120052352 00000100:00100000:0.0:1782241310.117639:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120051712 00000100:00100000:0.0:1782241310.117643:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120051712 00000100:00100000:3.0:1782241310.117645:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241310.117661:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120052224 00000100:00100000:0.0:1782241310.117665:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120052224 00000100:00100000:3.0:1782241310.117682:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 325 00000100:00100000:3.0:1782241310.117695:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815120051840:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241310.117726:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120051584 00000100:00100000:2.0:1782241310.117731:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120051584 00000100:00100000:2.0:1782241310.117804:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 390 00000100:00100000:2.0:1782241310.117814:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2399:x1868815120051584:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241310.117821:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815120051840:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 126us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241310.117848:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2399:x1868815120051584:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 36us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241310.117856:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 390 00000100:00100000:1.0:1782241310.124032:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120052096 00000100:00100000:1.0:1782241310.124048:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120052096 00000100:00100000:1.0:1782241310.124237:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120051968 00000100:00100000:1.0:1782241310.124241:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120051968 00000100:00100000:1.0:1782241310.124288:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 137 00000100:00100000:1.0:1782241310.124299:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2399:x1868815120052096:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241310.124379:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+8:2399:x1868815120052096:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 81us (6906us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241310.124386:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 137 00000100:00100000:1.0:1782241310.124404:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 138 00000100:00100000:1.0:1782241310.124410:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815120051968:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241310.124434:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2399:x1868815120051968:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 25us (6837us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241310.124468:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 138 00000100:00100000:3.0:1782241310.124780:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 325 00000100:00100000:0.0:1782241310.124794:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 326 00000100:00100000:0.0:1782241310.124807:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815120052352:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241310.124814:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 327 00000100:00100000:0.0:1782241310.124843:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815120052352:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 40us (7323us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241310.124850:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 326 00000100:00100000:0.0:1782241310.124864:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 328 00000100:00100000:0.0:1782241310.124872:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815120052224:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241310.124896:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815120052224:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 26us (7252us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241310.124903:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 328 00000100:00100000:3.0:1782241310.124924:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+32:2399:x1868815120051712:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241310.124964:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+32:2399:x1868815120051712:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 141us (7413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241310.124973:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 327 00000100:00080000:3.0:1782241310.125091:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782241310.125096:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782241310.125100:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1782241310.340995:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782241310.856649:0:13786:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782241310.980985:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140017152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241310.981062:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241310.981158:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140017152 00000100:00100000:2.0:1782241310.981167:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140017152 00000100:00100000:2.0:1782241310.981219:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1782241310.981229:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aa8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140017152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782241310.981265:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1782241310.995861:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aa8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140017152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 14624us (14790us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241310.995893:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1782241310.997792:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140017152:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1782241311.108945:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782241311.108954:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782241311.108972:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1782241311.108978:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1782241311.365006:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782241312.004964:0:9979:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375263204554ns, next at 376263201475ns, rc = 0 00000100:00100000:2.0:1782241312.005039:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140017280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241312.005115:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241312.005615:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140017536:0@lo:400:kworker.0 00000100:00100000:2.0:1782241312.005625:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140017792:0@lo:400:kworker.0 00000100:00100000:2.0:1782241312.005649:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241312.005672:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140018304:0@lo:400:kworker.0 00000100:00100000:3.0:1782241312.005675:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140017792 00000100:00100000:3.0:1782241312.005681:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140017792 00000100:00100000:2.0:1782241312.005695:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241312.005711:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140018816:0@lo:400:kworker.0 00000100:00100000:3.0:1782241312.005724:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1782241312.005729:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241312.005732:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140017792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241312.005745:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782241312.005749:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815140017408:0@lo:400:kworker.0 00000100:00100000:1.0:1782241312.005864:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140017280 00000100:00100000:1.0:1782241312.005868:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140017280 00000100:00100000:3.0:1782241312.005875:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140017792:12345-0@lo:400:kworker.0 Request processed in 143us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241312.005897:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1782241312.005903:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1782241312.005910:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815140017280:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782241312.005920:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1782241312.005933:0:14428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782241312.005938:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140018304 00000100:00100000:3.0:1782241312.005940:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140018304 00000100:00100000:3.0:1782241312.005965:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140018816 00000100:00100000:1.0:1782241312.005966:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815140017280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241312.005967:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140018816 00000100:00100000:1.0:1782241312.005972:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1782241312.005984:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1782241312.005989:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140018304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241312.005995:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1782241312.006001:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140018816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241312.006019:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140018304:12345-0@lo:400:kworker.0 Request processed in 29us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241312.006023:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140018816:12345-0@lo:400:kworker.0 Request processed in 22us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241312.006025:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782241312.006028:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1782241312.006041:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140017664:0@lo:400:kworker.0 00000100:00100000:2.0:1782241312.006092:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241312.006126:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241312.006136:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140017920:0@lo:400:kworker.0 00000100:00100000:3.0:1782241312.006143:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140018176:0@lo:400:kworker.0 00000100:00100000:3.0:1782241312.006160:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241312.006160:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241312.006204:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140017408 00000100:00100000:1.0:1782241312.006209:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140017408 00000100:00100000:1.0:1782241312.006372:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1782241312.006380:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815140017408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241312.007533:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140018688:0@lo:400:kworker.0 00000100:00100000:3.0:1782241312.007574:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241312.007696:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140017664 00000100:00100000:3.0:1782241312.007703:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140017664 00000100:00100000:3.0:1782241312.007736:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140017920 00000100:00100000:3.0:1782241312.007740:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140017920 00000100:00100000:3.0:1782241312.007770:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1782241312.007778:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140017664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241312.007824:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140017664:12345-0@lo:400:kworker.0 Request processed in 47us (1698us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241312.007831:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1782241312.007860:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1782241312.007865:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140017920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241312.007898:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140017920:12345-0@lo:400:kworker.0 Request processed in 32us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241312.007903:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:3.0:1782241312.007923:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782241312.007927:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241312.007955:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140017664:0@lo:400:kworker.0 00000100:00100000:3.0:1782241312.008000:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140018176 00000100:00100000:3.0:1782241312.008004:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140018176 00000100:00100000:3.0:1782241312.008033:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1782241312.008040:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140018176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241312.008076:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140018176:12345-0@lo:400:kworker.0 Request processed in 36us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241312.008081:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1782241312.008091:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140018688 00000100:00100000:3.0:1782241312.008094:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140018688 00000100:00100000:3.0:1782241312.008114:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1782241312.008120:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815140018688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241312.008145:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815140018688:12345-0@lo:400:kworker.0 Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241312.008150:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00080000:3.0:1782241312.008162:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1782241312.008183:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48837b80 x1868815140018176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241312.008195:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140018176:0@lo:400:kworker.0 00010000:00080000:3.0:1782241312.008216:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48834700 x1868815140018688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241312.008224:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140018688:0@lo:400:kworker.0 00000100:00100000:2.0:1782241312.008431:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140017920:0@lo:400:kworker.0 00000100:00100000:2.0:1782241312.008440:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140018432:0@lo:400:kworker.0 00000100:00100000:2.0:1782241312.008469:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241312.008699:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140017792:0@lo:400:kworker.0 00000100:00100000:2.0:1782241312.008712:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140018304:0@lo:400:kworker.0 00000100:00100000:2.0:1782241312.008724:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140018816:0@lo:400:kworker.0 00000100:00100000:2.0:1782241312.008743:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140017280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241312.008813:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140018432 00000100:00100000:3.0:1782241312.008818:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140018432 00000100:00100000:3.0:1782241312.008862:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1782241312.008868:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3637:x1868815140018432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241312.008906:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3637:x1868815140018432:12345-0@lo:400:kworker.0 Request processed in 38us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241312.008911:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1782241312.008972:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241312.008990:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140018432:0@lo:400:kworker.0 00000100:00100000:0.0:1782241312.009293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241312.009328:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815140018048:0@lo:400:kworker.0 00000100:00100000:3.0:1782241312.009332:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140017536 00000100:00100000:3.0:1782241312.009336:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140017536 00000100:00100000:0.0:1782241312.009356:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241312.009395:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815140018560:0@lo:400:kworker.0 00000100:00100000:0.0:1782241312.009427:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241312.009497:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815140017408:12345-0@lo:400:kworker.0 Request processed in 3117us (3403us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241312.009512:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1782241312.011085:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140018048 00000100:00100000:3.0:1782241312.011099:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140018048 00000100:00100000:3.0:1782241312.011165:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1782241312.011176:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140017536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241312.011248:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140017536:12345-0@lo:400:kworker.0 Request processed in 75us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241312.011255:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1782241312.011272:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1782241312.011278:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815140018048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241312.011306:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815140018048:12345-0@lo:400:kworker.0 Request processed in 28us (1948us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241312.011312:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1782241312.011374:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815140017408:0@lo:400:kworker.0 00000100:00080000:3.0:1782241312.011428:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241312.017211:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140017536:0@lo:400:kworker.0 00000100:00100000:0.0:1782241312.017360:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815140018048:0@lo:400:kworker.0 00000100:00100000:1.0:1782241312.017583:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140018560 00000100:00100000:1.0:1782241312.017591:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140018560 00000100:00100000:1.0:1782241312.017677:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1782241312.017687:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815140018560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241312.017778:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815140018560:12345-0@lo:400:kworker.0 Request processed in 92us (8349us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241312.017786:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00080000:0.0:1782241312.018006:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241312.018029:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815140018560:0@lo:400:kworker.0 00010000:00010000:3.0:1782241312.389334:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241312.517820:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782241312.517844:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140019072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241312.517917:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241312.517993:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140019072 00000100:00100000:1.0:1782241312.518000:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140019072 00000100:00100000:1.0:1782241312.518046:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1782241312.518055:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140019072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782241312.518078:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782241312.518124:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140019072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241312.518132:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1782241312.518185:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140019072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241312.518452:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140018944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241312.518484:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241312.518862:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140018944 00000100:00100000:1.0:1782241312.518868:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140018944 00000100:00100000:1.0:1782241312.518894:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1782241312.518900:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140018944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241312.519081:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241312.519134:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140018944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 233us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241312.519151:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1782241312.519232:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140018944:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1782241312.539004:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:1.0:1782241313.412996:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782241313.546588:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1782241313.546604:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000004:00080000:2.0:1782241313.546932:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:2.0:1782241313.546962:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:2.0:1782241313.546994:0:6489:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff890d46869480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1782241313.546999:0:6489:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e7d7fa100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff890d46869900 00000020:00080000:2.0:1782241313.547004:0:6489:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff890e7d7fa600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff890e7d6c6e00 00010000:00010000:1.0:1782241313.547004:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a708 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241313.547017:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a708 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241313.547026:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a708 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782241313.547030:0:6489:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1782241313.547033:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241313.547039:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a708 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241313.547048:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a708 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241313.547067:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff890e4bb38a00) 00010000:00010000:1.0:1782241313.547071:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241313.547076:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a708 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241313.547082:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1a708 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241313.547154:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241313.547235:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140019200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782241313.547303:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1782241313.547404:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1782241313.547486:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1782241313.547680:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140019200 00000100:00100000:0.0:1782241313.547688:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140019200 00000100:00100000:0.0:1782241313.547790:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1782241313.547800:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140019200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1782241313.549740:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1782241313.549749:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1782241307 -> 1782241307 00002000:00010000:0.0:1782241313.549752:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1782241306 -> 1782241306 00002000:00010000:0.0:1782241313.549768:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1782241307 -> 1782241307 00002000:00010000:0.0:1782241313.549771:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1782241313.549885:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815140019200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2074us (2569us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1782241313.549895:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782241313.550003:0:3639:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1782241313.550009:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1782241313.550032:0:3639:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff890d4836c380 x1868815140019200/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1782241329 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1782241313.550044:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890d4836c380/2, rc 0, transno 4294967325 00000100:00100000:2.0:1782241313.550050:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140019200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1782241314.054062:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782241314.054086:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140019328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782241314.054164:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241314.054246:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140019328 00000100:00100000:2.0:1782241314.054253:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140019328 00000100:00100000:2.0:1782241314.054306:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1782241314.054315:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140019328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782241314.054344:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782241314.054406:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140019328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241314.054414:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1782241314.054442:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241314.054479:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140019328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241314.056278:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241314.056299:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140019456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241314.056354:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241314.056681:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140019456 00000100:00100000:3.0:1782241314.056689:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140019456 00000100:00100000:3.0:1782241314.056797:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782241314.056807:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140019456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782241314.056829:0:14428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782241314.056874:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140019456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241314.056893:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782241314.056999:0:3637:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1782241314.057005:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1782241314.057024:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff890d4881f100, transno 4294967311 00000100:00100000:3.0:1782241314.057039:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140019456:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782241314.059548:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782241314.439865:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241315.129999:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241315.130254:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120052480 00000100:00100000:3.0:1782241315.130263:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120052480 00000100:00100000:3.0:1782241315.130370:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 255 00000100:00100000:3.0:1782241315.130381:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:12153:x1868815120052480:12345-192.168.204.58@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1782241315.130500:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:12153:x1868815120052480:12345-192.168.204.58@tcp:60:lhsmtool_posix.0 Request processed in 121us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241315.130508:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 255 00000100:00080000:2.0:1782241315.132279:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782241315.135593:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241315.135711:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120052608 00000100:00100000:1.0:1782241315.135721:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120052608 00000100:00100000:1.0:1782241315.135857:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 256 00000100:00100000:1.0:1782241315.135867:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:12153:x1868815120052608:12345-192.168.204.58@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1782241315.135976:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:12153:x1868815120052608:12345-192.168.204.58@tcp:60:lhsmtool_posix.0 Request processed in 110us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241315.135984:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 256 00000100:00080000:2.0:1782241315.136064:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782241315.138602:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241315.138693:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120052864 00000100:00100000:0.0:1782241315.138703:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120052864 00000100:00100000:0.0:1782241315.138788:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 65 00000100:00100000:0.0:1782241315.138800:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:12153:x1868815120052864:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782241315.139057:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:12153:x1868815120052864:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 258us (461us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1782241315.139065:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 65 00000100:00100000:0.0:1782241315.231717:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241315.231811:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241315.231833:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241315.231863:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241315.231884:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241315.231993:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120053504 00000100:00100000:3.0:1782241315.232003:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120053504 00000100:00100000:3.0:1782241315.232063:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120053376 00000100:00100000:3.0:1782241315.232067:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120053376 00000100:00100000:3.0:1782241315.232088:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 335 00000100:00100000:3.0:1782241315.232096:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815120053504:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241315.232162:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815120053504:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 66us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241315.232169:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 335 00000100:00100000:3.0:1782241315.232183:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 336 00000100:00100000:3.0:1782241315.232189:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815120053376:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241315.232218:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2396:x1868815120053376:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 30us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241315.232224:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 336 00000100:00100000:3.0:1782241315.232240:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120053248 00000100:00100000:3.0:1782241315.232243:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120053248 00000100:00100000:3.0:1782241315.232264:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120053120 00000100:00100000:3.0:1782241315.232266:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120053120 00000100:00100000:3.0:1782241315.232282:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 142 00000100:00100000:3.0:1782241315.232288:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2396:x1868815120053248:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241315.232325:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2396:x1868815120053248:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 37us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241315.232331:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 142 00000100:00100000:3.0:1782241315.232353:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 143 00000100:00100000:3.0:1782241315.232359:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815120053120:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241315.232379:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2396:x1868815120053120:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 21us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241315.232384:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 143 00000100:00080000:0.0:1782241315.234319:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782241315.234328:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782241315.234331:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241315.234334:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782241315.234409:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120052992 00000100:00100000:2.0:1782241315.234420:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120052992 00000100:00100000:2.0:1782241315.234479:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 392 00000100:00100000:2.0:1782241315.234489:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815120052992:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241315.234574:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2396:x1868815120052992:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 86us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241315.234581:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 392 00010000:00010000:2.0:1782241315.460996:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241315.659310:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241315.659436:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120053632 00000100:00100000:3.0:1782241315.659446:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120053632 00000100:00100000:3.0:1782241315.659511:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 257 00000100:00100000:3.0:1782241315.659530:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:12949:x1868815120053632:12345-192.168.204.58@tcp:101:lsof.0 00010000:00010000:3.0:1782241315.659555:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241315.659576:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a794 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335054c9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241315.659640:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a79b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241315.659654:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a79b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241315.659666:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a79b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241315.659717:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782241315.659721:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782241315.659814:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a79b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241315.659841:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ca00/0xc9959f2fb1e1a794 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054c9 expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241315.659861:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a79b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054c9 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241315.659870:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b100) 00010000:00010000:3.0:1782241315.659873:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782241315.659877:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c400, rc 0) 00000100:00100000:3.0:1782241315.659945:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:12949:x1868815120053632:12345-192.168.204.58@tcp:101:lsof.0 Request processed in 426us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241315.659953:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 257 00000100:00100000:1.0:1782241316.101066:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782241316.101100:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140019584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241316.101177:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241316.101396:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140019584 00000100:00100000:3.0:1782241316.101404:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140019584 00000100:00100000:3.0:1782241316.101459:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1782241316.101469:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140019584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782241316.101516:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1782241316.101567:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140019584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241316.101574:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1782241316.101752:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140019584:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782241316.485724:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241317.125588:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815140019968:0@lo:400:kworker.0 00000100:00100000:3.0:1782241317.125684:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241317.125782:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815140020480:0@lo:400:kworker.0 00000100:00100000:3.0:1782241317.125829:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241317.125854:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815140020992:0@lo:400:kworker.0 00000100:00100000:3.0:1782241317.125877:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241317.125906:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1782241317.125911:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140019840:0@lo:400:kworker.0 00000100:00100000:3.0:1782241317.125948:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241317.125969:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140020352:0@lo:400:kworker.0 00000100:00100000:3.0:1782241317.125995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241317.126011:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140020864:0@lo:400:kworker.0 00000100:00100000:3.0:1782241317.126034:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241317.126054:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140021376:0@lo:400:kworker.0 00000100:00100000:3.0:1782241317.126078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241317.126111:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140020864 00000100:00100000:3.0:1782241317.126120:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140020864 00000100:00100000:3.0:1782241317.126181:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140021376 00000100:00100000:3.0:1782241317.126184:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140021376 00000100:00100000:3.0:1782241317.126208:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782241317.126219:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140020864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241317.126284:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140020864:12345-0@lo:400:kworker.0 Request processed in 66us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241317.126292:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782241317.126323:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782241317.126330:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815140021376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241317.126371:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1868815140021376:12345-0@lo:400:kworker.0 Request processed in 42us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241317.126376:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1782241317.126399:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782241317.126405:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241317.126424:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140019968 00000100:00100000:3.0:1782241317.126427:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140019968 00000100:00100000:3.0:1782241317.126454:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140020480 00000100:00100000:3.0:1782241317.126457:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140020480 00000100:00100000:3.0:1782241317.126477:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140020992 00000100:00100000:3.0:1782241317.126480:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140020992 00000100:00100000:3.0:1782241317.126493:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1782241317.126498:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815140019968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241317.126534:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815140019968:12345-0@lo:400:kworker.0 Request processed in 35us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241317.126540:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1782241317.126552:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1782241317.126558:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815140020480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241317.126583:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1868815140020480:12345-0@lo:400:kworker.0 Request processed in 25us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241317.126588:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1782241317.126599:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1782241317.126605:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815140020992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241317.126630:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815140020992:12345-0@lo:400:kworker.0 Request processed in 26us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241317.126637:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00080000:3.0:1782241317.126652:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782241317.126704:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140020864:0@lo:400:kworker.0 00000100:00100000:3.0:1782241317.126716:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140021376:0@lo:400:kworker.0 00000100:00100000:3.0:1782241317.126726:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815140019968:0@lo:400:kworker.0 00000100:00100000:3.0:1782241317.126747:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815140020480:0@lo:400:kworker.0 00000100:00100000:3.0:1782241317.126786:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815140020992:0@lo:400:kworker.0 00000100:00100000:1.0:1782241317.126979:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140019840 00000100:00100000:1.0:1782241317.126984:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140019840 00000100:00100000:1.0:1782241317.127024:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1782241317.127031:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815140019840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241317.127075:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815140019840:12345-0@lo:400:kworker.0 Request processed in 45us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241317.127082:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1782241317.127113:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140020352 00000100:00100000:1.0:1782241317.127116:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140020352 00000100:00100000:0.0:1782241317.127116:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140020096:0@lo:400:kworker.0 00000100:00100000:1.0:1782241317.127142:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1782241317.127150:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140020352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241317.127150:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241317.127224:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140019712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241317.128831:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140020096 00000100:00100000:3.0:1782241317.128845:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140020096 00000100:00100000:3.0:1782241317.128891:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1782241317.128902:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140020096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241317.136829:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140020352:12345-0@lo:400:kworker.0 Request processed in 9664us (10817us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241317.136849:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1782241317.137105:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140019840:0@lo:400:kworker.0 00000100:00100000:1.0:1782241317.137149:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140020352:0@lo:400:kworker.0 00000100:00100000:0.0:1782241317.137827:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140020608:0@lo:400:kworker.0 00000100:00100000:0.0:1782241317.137889:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241317.138467:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140021120:0@lo:400:kworker.0 00000100:00100000:0.0:1782241317.138503:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241317.142162:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241317.142254:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140020224:0@lo:400:kworker.0 00000100:00100000:2.0:1782241317.142342:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140019712 00000100:00100000:2.0:1782241317.142352:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140019712 00000100:00100000:2.0:1782241317.142424:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782241317.142435:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1868815140019712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782241317.143040:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782241317.143119:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1868815140019712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 685us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241317.143127:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1782241317.146889:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241317.147088:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140020096:12345-0@lo:400:kworker.0 Request processed in 18182us (19931us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241317.147105:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1782241317.155978:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140020608 00000100:00100000:1.0:1782241317.156001:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140020608 00000100:00100000:1.0:1782241317.156183:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140021120 00000100:00100000:1.0:1782241317.156187:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140021120 00000100:00100000:1.0:1782241317.156222:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1782241317.156233:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140020608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241317.156611:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140020608:12345-0@lo:400:kworker.0 Request processed in 378us (18720us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241317.156619:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1782241317.156640:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1782241317.156646:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815140021120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241317.156733:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815140021120:12345-0@lo:400:kworker.0 Request processed in 87us (18229us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241317.156740:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1782241317.156866:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140020096:0@lo:400:kworker.0 00010000:00080000:1.0:1782241317.156884:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48136300 x1868815140020608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241317.156895:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140020608:0@lo:400:kworker.0 00010000:00080000:1.0:1782241317.156907:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48835c00 x1868815140021120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241317.156916:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140021120:0@lo:400:kworker.0 00000100:00080000:3.0:1782241317.156935:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782241317.165971:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140020736:0@lo:400:kworker.0 00000100:00100000:0.0:1782241317.166070:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241317.166126:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140021248:0@lo:400:kworker.0 00000100:00100000:0.0:1782241317.166151:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241317.166234:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140020224 00000100:00100000:0.0:1782241317.166240:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140019712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241317.166244:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140020224 00000100:00100000:3.0:1782241317.166322:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1782241317.166333:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815140020224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241317.166416:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140020736 00000100:00100000:1.0:1782241317.166421:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140020736 00000100:00100000:1.0:1782241317.166475:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140021248 00000100:00100000:1.0:1782241317.166479:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140021248 00000100:00100000:1.0:1782241317.166502:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1782241317.166509:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140020736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241317.166557:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140020736:12345-0@lo:400:kworker.0 Request processed in 48us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241317.166565:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1782241317.166584:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782241317.166590:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140021248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241317.166618:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140021248:12345-0@lo:400:kworker.0 Request processed in 28us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241317.166624:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1782241317.170432:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815140020224:12345-0@lo:400:kworker.0 Request processed in 4083us (23539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241317.170463:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00080000:0.0:1782241317.171379:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782241317.171387:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241317.171453:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140020224:0@lo:400:kworker.0 00000100:00100000:0.0:1782241317.171475:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140020736:0@lo:400:kworker.0 00000100:00100000:0.0:1782241317.171488:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140021248:0@lo:400:kworker.0 00010000:00010000:1.0:1782241317.508997:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241317.637817:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241317.637851:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140021504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241317.637978:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241317.638067:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782241317.638078:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140021632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241317.638115:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241317.638349:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140021632 00000100:00100000:2.0:1782241317.638358:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140021632 00000100:00100000:2.0:1782241317.638421:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782241317.638431:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140021632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782241317.638468:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782241317.638532:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140021632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241317.638540:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1782241317.638860:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140021504 00000100:00100000:1.0:1782241317.638865:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140021504 00000100:00100000:1.0:1782241317.638903:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1782241317.638909:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140021504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241317.638941:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241317.638996:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140021504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241317.639003:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1782241317.639215:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140021504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241317.639364:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140021632:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1782241318.534846:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241319.172955:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241319.172989:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140021760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241319.173058:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782241319.173069:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140021888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241319.173096:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241319.173187:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140021760 00000100:00100000:0.0:1782241319.173197:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140021760 00000100:00100000:0.0:1782241319.173274:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782241319.173286:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140021760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782241319.173327:0:14428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1782241319.186414:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241319.196252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241319.196357:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140021888 00000100:00100000:1.0:1782241319.196369:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140021888 00000100:00100000:1.0:1782241319.196454:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782241319.196476:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140021888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782241319.196520:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241319.196579:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140021888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241319.196587:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782241319.196679:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140021888:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782241319.196874:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241319.203698:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140021760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 30399us (30587us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241319.203718:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1782241319.203915:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140021760:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1782241319.558226:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782241319.694243:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000020:00080000:2.0:1782241319.694281:0:6489:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:2.0:1782241319.696585:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000020:00080000:0.0:1782241319.697836:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1782241319.700350:0:6542:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1782241320.072373:0:13786:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1782241320.163322:0:14861:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 15:01:58 (1782241318) 00000100:00100000:1.0:1782241320.356191:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241320.356257:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241320.356297:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241320.356318:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241320.356346:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241320.356374:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241320.356406:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241320.356442:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120054272 00000100:00100000:1.0:1782241320.356455:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120054272 00000100:00100000:1.0:1782241320.356529:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120054144 00000100:00100000:1.0:1782241320.356533:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120054144 00000100:00100000:1.0:1782241320.356567:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 148 00000100:00100000:1.0:1782241320.356581:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2397:x1868815120054272:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241320.356684:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2397:x1868815120054272:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 105us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241320.356693:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 148 00000100:00100000:1.0:1782241320.356715:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 149 00000100:00100000:1.0:1782241320.356723:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815120054144:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241320.356752:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815120054144:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 31us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241320.356817:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 149 00000100:00100000:1.0:1782241320.356843:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120054016 00000100:00100000:1.0:1782241320.356847:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120054016 00000100:00100000:1.0:1782241320.356879:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120054528 00000100:00100000:2.0:1782241320.356985:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120053888 00000100:00100000:2.0:1782241320.356989:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120053888 00000100:00100000:2.0:1782241320.357013:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120054400 00000100:00100000:2.0:1782241320.357015:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120054400 00000100:00100000:2.0:1782241320.357035:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 343 00000100:00100000:2.0:1782241320.357043:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815120054016:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241320.357080:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2397:x1868815120054016:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 37us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241320.357087:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 343 00000100:00100000:2.0:1782241320.357102:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 344 00000100:00100000:2.0:1782241320.357110:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:2397:x1868815120053888:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241320.357151:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:2397:x1868815120053888:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 43us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241320.357169:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 344 00000100:00100000:2.0:1782241320.357184:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 345 00000100:00100000:2.0:1782241320.357191:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2397:x1868815120054400:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241320.357220:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2397:x1868815120054400:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 29us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241320.357226:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 345 00000100:00100000:3.0:1782241320.357338:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120053760 00000100:00100000:3.0:1782241320.357345:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120053760 00000100:00100000:3.0:1782241320.357398:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 394 00000100:00100000:3.0:1782241320.357410:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2397:x1868815120053760:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241320.357445:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+13:2397:x1868815120053760:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 37us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241320.357451:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 394 00000100:00100000:1.0:1782241320.360911:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120054528 00000100:00100000:1.0:1782241320.360997:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 346 00000100:00100000:1.0:1782241320.361009:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2397:x1868815120054528:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241320.361106:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2397:x1868815120054528:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 99us (4786us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241320.361116:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 346 00000100:00080000:1.0:1782241320.361145:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782241320.361150:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241320.361154:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782241320.361157:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782241320.585480:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241321.227299:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140022016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241321.227419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241321.227535:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140022016 00000100:00100000:1.0:1782241321.227545:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140022016 00000100:00100000:1.0:1782241321.227610:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1782241321.227621:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140022016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782241321.227667:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1782241321.227724:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140022016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241321.227732:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1782241321.227811:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140022016:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1782241321.349292:0:13782:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782241321.349307:0:13782:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782241321.349448:0:13782:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1782241321.350411:0:13782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1782241321.608944:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241322.245321:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782241322.245355:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140022144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241322.245456:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241322.245708:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140022144 00000100:00100000:1.0:1782241322.245719:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140022144 00000100:00100000:1.0:1782241322.245834:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1782241322.245846:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140022144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782241322.245885:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782241322.245945:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140022144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (490us total) trans 0 rc 0/0 00000100:00080000:2.0:1782241322.246192:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782241322.246247:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1782241322.246310:0:3640:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1782241322.246316:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff890d4836c380, transno 4294967325 00000100:00100000:1.0:1782241322.246341:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140022144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782241322.246407:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815140022272:0@lo:400:kworker.0 00000100:00100000:1.0:1782241322.246451:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241322.246481:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140022400:0@lo:400:kworker.0 00000100:00100000:1.0:1782241322.246481:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140022784:0@lo:400:kworker.0 00000100:00100000:1.0:1782241322.246507:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241322.246510:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241322.246856:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815140022656:0@lo:400:kworker.0 00000100:00100000:0.0:1782241322.247646:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140022272 00000100:00100000:0.0:1782241322.247656:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140022272 00000100:00100000:0.0:1782241322.247714:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1782241322.247724:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815140022272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241322.257184:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140023296:0@lo:400:kworker.0 00000100:00100000:1.0:1782241322.257311:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241322.257491:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140022784 00000100:00100000:1.0:1782241322.257502:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140022784 00000100:00100000:1.0:1782241322.257568:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1782241322.257587:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140022784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241322.257946:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140022912:0@lo:400:kworker.0 00000100:00100000:2.0:1782241322.257996:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241322.258094:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815140023424:0@lo:400:kworker.0 00000100:00100000:2.0:1782241322.258123:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241322.258151:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782241322.258160:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140022528:0@lo:400:kworker.0 00000100:00100000:2.0:1782241322.258186:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241322.258218:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140023040:0@lo:400:kworker.0 00000100:00100000:2.0:1782241322.258241:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241322.258260:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140023552:0@lo:400:kworker.0 00000100:00100000:2.0:1782241322.258281:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241322.258531:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140022784:12345-0@lo:400:kworker.0 Request processed in 952us (12021us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241322.258541:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1782241322.258559:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140022400 00000100:00100000:1.0:1782241322.258562:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140022528 00000100:00100000:2.0:1782241322.258565:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140022400 00000100:00100000:1.0:1782241322.258565:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140022528 00000100:00100000:1.0:1782241322.258594:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1782241322.258601:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140022528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241322.258721:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140022528:12345-0@lo:400:kworker.0 Request processed in 119us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241322.258728:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1782241322.258772:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140022912 00000100:00100000:1.0:1782241322.258776:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140022912 00000100:00100000:1.0:1782241322.258810:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140023424 00000100:00100000:1.0:1782241322.258813:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140023424 00000100:00100000:1.0:1782241322.258830:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140023040 00000100:00100000:1.0:1782241322.258833:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140023040 00000100:00100000:1.0:1782241322.258847:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140023552 00000100:00100000:1.0:1782241322.258850:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140023552 00000100:00100000:1.0:1782241322.258863:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1782241322.258870:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140022912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241322.258905:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140022912:12345-0@lo:400:kworker.0 Request processed in 35us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241322.258911:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1782241322.258926:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1782241322.258931:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815140023424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241322.258958:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815140023424:12345-0@lo:400:kworker.0 Request processed in 27us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241322.258965:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1782241322.258975:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1782241322.258980:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140023040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241322.259004:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140023040:12345-0@lo:400:kworker.0 Request processed in 24us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241322.259019:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1782241322.259031:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1782241322.259037:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815140023552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241322.259066:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815140023552:12345-0@lo:400:kworker.0 Request processed in 29us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241322.259072:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1782241322.259114:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1782241322.259117:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140022784:0@lo:400:kworker.0 00000100:00100000:2.0:1782241322.259121:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140022400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241322.259154:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140022528:0@lo:400:kworker.0 00000100:00100000:2.0:1782241322.259155:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140022400:12345-0@lo:400:kworker.0 Request processed in 35us (12645us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241322.259162:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00010000:00080000:1.0:1782241322.259168:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4881aa00 x1868815140023040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241322.259180:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140023040:0@lo:400:kworker.0 00000100:00100000:2.0:1782241322.259182:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140023296 00000100:00100000:2.0:1782241322.259186:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140023296 00010000:00080000:1.0:1782241322.259189:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48819180 x1868815140023552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241322.259197:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140023552:0@lo:400:kworker.0 00000100:00100000:1.0:1782241322.259221:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140022400:0@lo:400:kworker.0 00000100:00100000:2.0:1782241322.259228:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1782241322.259233:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140022912:0@lo:400:kworker.0 00000100:00100000:2.0:1782241322.259234:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140023296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241322.259242:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815140023424:0@lo:400:kworker.0 00000100:00100000:2.0:1782241322.259274:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140023296:12345-0@lo:400:kworker.0 Request processed in 40us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241322.259281:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1782241322.259311:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782241322.259317:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241322.259319:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241322.259335:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140023296:0@lo:400:kworker.0 00000100:00100000:3.0:1782241322.260936:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241322.260995:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140023168:0@lo:400:kworker.0 00000100:00100000:3.0:1782241322.261052:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241322.261073:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140023680:0@lo:400:kworker.0 00000100:00100000:3.0:1782241322.261095:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241322.261128:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140023168 00000100:00100000:3.0:1782241322.261134:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140023168 00000100:00100000:3.0:1782241322.261216:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140023680 00000100:00100000:3.0:1782241322.261220:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140023680 00000100:00100000:3.0:1782241322.261244:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1782241322.261254:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140023168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241322.261307:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140023168:12345-0@lo:400:kworker.0 Request processed in 54us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241322.261314:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1782241322.261332:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782241322.261338:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140023680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241322.261363:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140023680:12345-0@lo:400:kworker.0 Request processed in 26us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241322.261369:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1782241322.261405:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782241322.261410:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241322.261440:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140023680:0@lo:400:kworker.0 00000100:00100000:3.0:1782241322.261472:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140023168:0@lo:400:kworker.0 00000100:00100000:2.0:1782241322.261933:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140022656 00000100:00100000:2.0:1782241322.261940:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140022656 00000100:00100000:2.0:1782241322.261988:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1782241322.261997:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815140022656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241322.262135:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815140022656:12345-0@lo:400:kworker.0 Request processed in 139us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241322.262142:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1782241322.262241:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815140022656:0@lo:400:kworker.0 00000100:00100000:0.0:1782241322.267909:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:62797b42-772f-434f-be35-dfdfcff291e0+24:3640:x1868815140022272:12345-0@lo:400:kworker.0 Request processed in 20168us (21438us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241322.267931:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1782241322.268136:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815140022272:0@lo:400:kworker.0 00010000:00010000:3.0:1782241322.629238:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241322.758156:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140023808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241322.758250:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241322.758427:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140023808 00000100:00100000:0.0:1782241322.758437:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140023808 00000100:00100000:0.0:1782241322.758509:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782241322.758521:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140023808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241322.758550:0:14428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782241322.758612:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241322.758629:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140023808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241322.758638:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140023936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241322.758647:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1782241322.758719:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241322.758845:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140023936 00000100:00100000:0.0:1782241322.758850:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140023936 00000100:00100000:0.0:1782241322.758883:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1782241322.758890:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140023936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241322.758918:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782241322.758959:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140023936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241322.758966:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1782241322.759386:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140023808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241322.761168:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140023936:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782241323.653071:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241324.222240:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241324.222471:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120054784 00000100:00100000:3.0:1782241324.222485:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120054784 00000100:00100000:3.0:1782241324.222575:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 66 00000100:00100000:3.0:1782241324.222589:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+18:13173:x1868815120054784:12345-192.168.204.58@tcp:35:umount.0 00000100:00100000:3.0:1782241324.222983:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:13173:x1868815120054784:12345-192.168.204.58@tcp:35:umount.0 Request processed in 397us (758us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1782241324.222992:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 66 00000100:00080000:1.0:1782241324.223392:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241324.226547:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241324.226695:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120055040 00000100:00100000:0.0:1782241324.226709:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120055040 00000100:00100000:0.0:1782241324.226863:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 67 00000100:00100000:0.0:1782241324.226876:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+19:13173:x1868815120055040:12345-192.168.204.58@tcp:35:umount.0 00000100:00100000:0.0:1782241324.227407:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:13173:x1868815120055040:12345-192.168.204.58@tcp:35:umount.0 Request processed in 532us (871us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1782241324.227416:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 67 00000100:00100000:0.0:1782241324.229732:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241324.229941:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120055296 00000100:00100000:3.0:1782241324.229954:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120055296 00000100:00100000:3.0:1782241324.230066:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 68 00000100:00100000:3.0:1782241324.230091:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47a4b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+20:13173:x1868815120055296:12345-192.168.204.58@tcp:35:umount.0 00000100:00100000:3.0:1782241324.230410:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47a4b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:13173:x1868815120055296:12345-192.168.204.58@tcp:35:umount.0 Request processed in 333us (691us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1782241324.230419:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 68 00000100:00100000:1.0:1782241324.233079:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241324.233225:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120055552 00000100:00100000:0.0:1782241324.233237:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120055552 00000100:00100000:0.0:1782241324.233351:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 69 00000100:00100000:0.0:1782241324.233364:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:13173:x1868815120055552:12345-192.168.204.58@tcp:35:umount.0 00000100:00100000:0.0:1782241324.233917:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:13173:x1868815120055552:12345-192.168.204.58@tcp:35:umount.0 Request processed in 553us (849us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1782241324.233927:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 69 00000100:00100000:1.0:1782241324.238890:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241324.238992:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241324.239641:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241324.239798:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120055680 00000100:00100000:2.0:1782241324.239810:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120055680 00000100:00100000:2.0:1782241324.240324:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120055808 00000100:00100000:2.0:1782241324.240330:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120055808 00000100:00100000:1.0:1782241324.240368:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120055936 00000100:00100000:1.0:1782241324.240372:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120055936 00000100:00100000:0.0:1782241324.240440:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:0.0:1782241324.240455:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+15:2396:x1868815120055680:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241324.240475:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241324.240502:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b860a00/0xc9959f2fb1e19772 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350501c expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241324.240526:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241324.240631:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00100000:1.0:1782241324.240640:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+14:2398:x1868815120055936:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241324.240651:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782241324.240661:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 23 00010000:00010000:1.0:1782241324.240662:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e821c2800/0xc9959f2fb1e196b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333504fdd expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241324.240669:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+14:2396:x1868815120055808:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241324.240673:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782241324.240675:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241324.240684:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e43fada00/0xc9959f2fb1e199c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050f5 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241324.240692:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241324.240738:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+12:2396:x1868815120055680:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 286us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241324.240747:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:3.0:1782241324.240814:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241324.240846:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120056320 00000100:00100000:3.0:1782241324.240851:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120056320 00000100:00100000:3.0:1782241324.240896:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 81 00000100:00100000:3.0:1782241324.240904:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+7:2395:x1868815120056320:12345-192.168.204.58@tcp:9:umount.0 00000100:00080000:0.0:1782241324.240952:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782241324.241026:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:2398:x1868815120055936:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 387us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241324.241034:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00100000:2.0:1782241324.241243:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2396:x1868815120055808:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 574us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241324.241251:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 23 00000020:00000080:3.0:1782241324.242043:0:8426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19cff 00000020:00010000:3.0:1782241324.242066:0:8426:0:(genops.c:1942:obd_stale_export_put()) Put export ffff890e53bee000: total 0 00000100:00080000:3.0:1782241324.242070:0:8426:0:(import.c:65:import_set_state_nolock()) ffff890e521be000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782241324.242196:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:2.0:1782241324.242197:0:8440:0:(genops.c:1928:obd_stale_export_get()) Get export ffff890e53bee000: total 0 00010000:00010000:2.0:1782241324.242245:0:8440:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff890e53bee000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1782241324.242307:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1a0be lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052df expref: 7 pid: 8747 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241324.242344:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a4baf95/0xc9959f2fb1e1a78d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054c2 expref: 4 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241324.242360:0:8440:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff890e53bee000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1782241324.242372:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241324.242375:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241324.242377:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241324.242417:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+2:2395:x1868815120056320:12345-192.168.204.58@tcp:9:umount.0 Request processed in 1513us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241324.242426:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 81 00000100:00100000:2.0:1782241324.245871:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241324.245940:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120056448 00000100:00100000:3.0:1782241324.245955:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120056448 00000100:00080000:0.0:1782241324.246065:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241324.246123:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 82 00000100:00100000:1.0:1782241324.246142:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2395:x1868815120056448:12345-192.168.204.58@tcp:9:umount.0 00000020:00000080:1.0:1782241324.247203:0:8746:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19a90 00000100:00080000:1.0:1782241324.247225:0:8746:0:(import.c:65:import_set_state_nolock()) ffff890d46665000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1782241324.247294:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1782241324.247298:0:8746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1782241324.248117:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+2:2395:x1868815120056448:12345-192.168.204.58@tcp:9:umount.0 Request processed in 1975us (2362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241324.248130:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 82 00000100:00100000:0.0:1782241324.255468:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241324.255975:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120057472 00000100:00100000:2.0:1782241324.255990:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120057472 00000100:00100000:2.0:1782241324.256245:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 258 00000100:00100000:2.0:1782241324.256277:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+22:2395:x1868815120057472:12345-192.168.204.58@tcp:39:umount.0 00000020:00000080:2.0:1782241324.256326:0:6512:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e196c3 00000020:00010000:2.0:1782241324.256469:0:6512:0:(genops.c:1942:obd_stale_export_put()) Put export ffff890d469bd000: total 0 00000100:00080000:2.0:1782241324.256476:0:6512:0:(import.c:65:import_set_state_nolock()) ffff890d4797b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782241324.256555:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:2.0:1782241324.256836:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+21:2395:x1868815120057472:12345-192.168.204.58@tcp:39:umount.0 Request processed in 561us (1383us total) trans 4294967529 rc 0/0 00000100:00100000:2.0:1782241324.256846:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 258 00000020:00010000:3.0:1782241324.257470:0:6499:0:(genops.c:1928:obd_stale_export_get()) Get export ffff890d469bd000: total 0 00010000:00010000:3.0:1782241324.257544:0:6499:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff890d469bd000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1782241324.257592:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:3.0:1782241324.257597:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782241324.257607:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c800/0xc9959f2fb1e1a778 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054bb expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241324.257632:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:3.0:1782241324.257635:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782241324.257639:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e47180200/0xc9959f2fb1e19a66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350511f expref: 19 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241324.257654:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:3.0:1782241324.257656:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782241324.257660:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb600/0xc9959f2fb1e1a430 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335053db expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241324.258848:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:3.0:1782241324.258858:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782241324.258869:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4b861e00/0xc9959f2fb1e1a74e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054ad expref: 17 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241324.258993:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b100) 00010000:00010000:3.0:1782241324.258997:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782241324.259002:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e778f1200/0xc9959f2fb1e1a127 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052fb expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241324.259020:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890e81fbc300) 00010000:00010000:3.0:1782241324.259022:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241324.259026:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eaa00/0xc9959f2fb1e19a0b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350510a expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241324.259051:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:3.0:1782241324.259053:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782241324.259058:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c600/0xc9959f2fb1e1a07f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052ca expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241324.259197:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:3.0:1782241324.259201:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782241324.259206:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac600/0xc9959f2fb1e1a0a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335052d8 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241324.259226:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff890e528b3a00) 00010000:00010000:3.0:1782241324.259228:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782241324.259232:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e19d61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335051f8 expref: 12 pid: 10147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241324.259248:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff890e81fbcb00) 00010000:00010000:3.0:1782241324.259250:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782241324.259262:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1a66e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505475 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241324.259281:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff890d4195b800) 00010000:00010000:3.0:1782241324.259284:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782241324.259288:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164de00/0xc9959f2fb1e19f9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505292 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241324.259304:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff890e81fbcd00) 00010000:00010000:3.0:1782241324.259307:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782241324.259310:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb000/0xc9959f2fb1e199ef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505103 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241324.259324:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff890d4781c300) 00010000:00010000:3.0:1782241324.259326:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782241324.259330:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c200/0xc9959f2fb1e1a143 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505302 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241324.259356:0:6499:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff890d469bd000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1782241324.259401:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241324.259404:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241324.259407:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241324.266661:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241324.266890:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120057600 00000100:00100000:2.0:1782241324.266903:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120057600 00000100:00100000:2.0:1782241324.267002:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 259 00000100:00100000:2.0:1782241324.267016:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+5:2395:x1868815120057600:12345-192.168.204.58@tcp:39:umount.0 00000020:00000080:2.0:1782241324.267061:0:6510:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e196ca 00000100:00080000:2.0:1782241324.267095:0:6510:0:(import.c:65:import_set_state_nolock()) ffff890d4797a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782241324.267136:0:6510:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1782241324.267376:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8052d7b9-50cc-405f-b8e0-5c9d863c1c52+3:2395:x1868815120057600:12345-192.168.204.58@tcp:39:umount.0 Request processed in 362us (727us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1782241324.267385:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 259 00000100:00080000:0.0:1782241324.268319:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1782241324.268831:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241324.293125:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140024064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782241324.293253:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241324.293698:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140024064 00000100:00100000:1.0:1782241324.293708:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140024064 00000100:00100000:1.0:1782241324.293810:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1782241324.293822:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140024064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782241324.293859:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241324.293932:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140024064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241324.293939:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1782241324.294177:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241324.294638:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140024064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241324.296432:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140024192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241324.296519:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241324.296683:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140024192 00000100:00100000:0.0:1782241324.296692:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140024192 00000100:00100000:0.0:1782241324.296787:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782241324.296797:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140024192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782241324.296827:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241324.296901:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140024192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241324.296908:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1782241324.297112:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140024192:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1782241324.297431:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782241324.680574:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241325.474393:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241325.474456:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241325.474483:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120057728 00000100:00100000:2.0:1782241325.474498:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120057728 00000100:00100000:0.0:1782241325.474504:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241325.474590:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 396 00000100:00100000:2.0:1782241325.474603:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2399:x1868815120057728:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241325.474718:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2399:x1868815120057728:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 116us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241325.474727:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 396 00000100:00100000:1.0:1782241325.474873:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120057984 00000100:00100000:1.0:1782241325.474879:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120057984 00000100:00100000:1.0:1782241325.474933:0:11191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120057856 00000100:00100000:1.0:1782241325.474937:0:11191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120057856 00000100:00100000:1.0:1782241325.474962:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 353 00000100:00100000:1.0:1782241325.474970:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815120057984:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241325.475009:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2399:x1868815120057984:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 40us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241325.475016:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 353 00000100:00100000:1.0:1782241325.475031:0:11191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 354 00000100:00100000:1.0:1782241325.475037:0:11191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2399:x1868815120057856:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241325.475073:0:11191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2399:x1868815120057856:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 37us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241325.475079:0:11191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 354 00000100:00080000:2.0:1782241325.475319:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782241325.475325:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1782241325.701290:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241325.984952:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241325.985221:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120058240 00000100:00100000:3.0:1782241325.985236:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120058240 00000100:00100000:2.0:1782241325.986277:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241325.991705:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241325.992282:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120058112 00000100:00100000:3.0:1782241325.992297:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120058112 00000100:00100000:3.0:1782241325.992415:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:3.0:1782241325.992427:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+11:2399:x1868815120058240:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241325.992449:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241325.992475:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e778f0a00/0xc9959f2fb1e197cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505062 expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241325.992497:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241325.992574:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+10:2399:x1868815120058240:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 148us (8240us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241325.992583:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:3.0:1782241325.992619:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:3.0:1782241325.992626:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e436c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+9:2399:x1868815120058112:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241325.992633:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241325.992643:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e778f0c00/0xc9959f2fb1e197c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505031 expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241325.992652:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241325.992669:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e436c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+8:2399:x1868815120058112:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 44us (6402us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241325.992675:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:2.0:1782241326.000019:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241326.000198:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120058624 00000100:00100000:3.0:1782241326.000212:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120058624 00000100:00100000:3.0:1782241326.000291:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 260 00000100:00100000:3.0:1782241326.000303:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+6:2395:x1868815120058624:12345-192.168.204.58@tcp:39:umount.0 00000020:00000080:3.0:1782241326.000410:0:10147:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e197db 00000020:00010000:3.0:1782241326.000424:0:10147:0:(genops.c:1942:obd_stale_export_put()) Put export ffff890d4785b800: total 0 00000100:00080000:3.0:1782241326.000429:0:10147:0:(import.c:65:import_set_state_nolock()) ffff890d47859000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782241326.000461:0:10147:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00100000:3.0:1782241326.000687:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2395:x1868815120058624:12345-192.168.204.58@tcp:39:umount.0 Request processed in 385us (682us total) trans 4294967530 rc 0/0 00000100:00100000:3.0:1782241326.000696:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 260 00000020:00010000:3.0:1782241326.000726:0:6499:0:(genops.c:1928:obd_stale_export_get()) Get export ffff890d4785b800: total 0 00010000:00010000:3.0:1782241326.001171:0:6499:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff890d4785b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782241326.001221:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195b100) 00010000:00010000:3.0:1782241326.001226:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782241326.001237:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164c400/0xc9959f2fb1e1a79b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054c9 expref: 4 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241326.001269:0:6499:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff890d4785b800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1782241326.001282:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241326.001284:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241326.001286:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241326.004567:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120058368 00000100:00100000:1.0:1782241326.004590:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120058368 00000100:00100000:1.0:1782241326.004914:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 26 00000100:00100000:1.0:1782241326.004928:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+8:2398:x1868815120058368:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241326.004955:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241326.004982:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779eac00/0xc9959f2fb1e199be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335050ee expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241326.005006:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241326.005240:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+7:2398:x1868815120058368:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 313us (13548us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241326.005249:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 26 00000100:00100000:2.0:1782241326.011891:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241326.012192:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120058752 00000100:00100000:3.0:1782241326.012207:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120058752 00000100:00100000:3.0:1782241326.012287:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 261 00000100:00100000:3.0:1782241326.012300:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+5:2395:x1868815120058752:12345-192.168.204.58@tcp:39:umount.0 00000020:00000080:3.0:1782241326.012371:0:6511:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e197e2 00000100:00080000:3.0:1782241326.012393:0:6511:0:(import.c:65:import_set_state_nolock()) ffff890d47b7b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782241326.012432:0:6511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1782241326.012889:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:863fc9a5-c349-42ab-bac8-b8fe4972688d+3:2395:x1868815120058752:12345-192.168.204.58@tcp:39:umount.0 Request processed in 588us (1014us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1782241326.012922:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 261 00010000:00010000:1.0:1782241326.013404:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241326.053749:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241326.055421:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120059008 00000100:00100000:3.0:1782241326.055441:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120059008 00000100:00100000:3.0:1782241326.055547:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 397 00000100:00100000:3.0:1782241326.055560:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+7:2395:x1868815120059008:12345-192.168.204.58@tcp:251:umount.0 00000020:00000080:3.0:1782241326.055639:0:6503:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e196a0 00000020:00010000:3.0:1782241326.055649:0:6503:0:(genops.c:1942:obd_stale_export_put()) Put export ffff890e77aa9000: total 0 00000100:00080000:3.0:1782241326.055655:0:6503:0:(import.c:65:import_set_state_nolock()) ffff890e77aaf800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1782241326.055886:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:061bd6f5-9369-4a7c-80a4-94b8e73a58d0+3:2395:x1868815120059008:12345-192.168.204.58@tcp:251:umount.0 Request processed in 327us (2152us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241326.055896:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 397 00000020:00010000:0.0:1782241326.055998:0:8440:0:(genops.c:1928:obd_stale_export_get()) Get export ffff890e77aa9000: total 0 00010000:00010000:0.0:1782241326.056004:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241326.056078:0:8440:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff890e77aa9000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782241326.056122:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e82056400/0xc9959f2fb1e19779 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505023 expref: 2 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241326.056162:0:8440:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff890e77aa9000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1782241326.056178:0:8440:0:(genops.c:906:class_export_put()) final put ffff890e77aa9000/061bd6f5-9369-4a7c-80a4-94b8e73a58d0 00010000:00010000:0.0:1782241326.056190:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241326.056193:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241326.056195:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782241326.056202:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e77aa9000/061bd6f5-9369-4a7c-80a4-94b8e73a58d0 for MGS 00000020:00000080:1.0:1782241326.056257:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e77aaf800 for MGS 00000100:00100000:1.0:1782241326.341394:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140024320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241326.341613:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241326.341720:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140024320 00000100:00100000:1.0:1782241326.341730:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140024320 00000100:00100000:1.0:1782241326.341844:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1782241326.341858:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140024320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782241326.341911:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1782241326.341988:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140024320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241326.342008:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1782241326.342080:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140024320:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782241326.725017:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782241326.865460:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 863fc9a5-c349-42ab-bac8-b8fe4972688d 00000001:00080000:1.0:1782241326.865484:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967530 is committed 00000020:00000080:1.0:1782241326.865494:0:6489:0:(genops.c:906:class_export_put()) final put ffff890d4785b800/863fc9a5-c349-42ab-bac8-b8fe4972688d 00000001:00100000:1.0:1782241326.865629:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000001:00080000:1.0:1782241326.865635:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:1.0:1782241326.865645:0:6489:0:(genops.c:906:class_export_put()) final put ffff890d469bd000/8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000020:00000080:3.0:1782241326.866107:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890d4785b800/863fc9a5-c349-42ab-bac8-b8fe4972688d for lustre-MDT0000 00000020:00000080:3.0:1782241326.866211:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d47859000 for lustre-MDT0000 00000020:00000080:3.0:1782241326.866512:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff890d469bd000/8052d7b9-50cc-405f-b8e0-5c9d863c1c52 for lustre-MDT0000 00000020:00000080:3.0:1782241326.866630:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d4797b800 for lustre-MDT0000 00000100:00100000:0.0:1782241327.366484:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815140024448:0@lo:400:kworker.0 00000100:00100000:3.0:1782241327.367488:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140024576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241327.367584:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241327.367689:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140024576 00000100:00100000:3.0:1782241327.367698:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140024576 00000100:00100000:3.0:1782241327.367787:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782241327.367798:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140024576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782241327.367839:0:14428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782241327.367891:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140024576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241327.367900:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1782241327.367945:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782241327.367991:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140024576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241327.368551:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241327.368707:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140024960:0@lo:400:kworker.0 00000100:00100000:0.0:1782241327.368748:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241327.368803:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140024960 00000100:00100000:0.0:1782241327.368809:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140024960 00000100:00100000:0.0:1782241327.368844:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1782241327.368852:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140024960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241327.368907:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140024960:12345-0@lo:400:kworker.0 Request processed in 55us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241327.368976:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1782241327.369007:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140024960:0@lo:400:kworker.0 00000100:00100000:0.0:1782241327.369049:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241327.369055:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140025088:0@lo:400:kworker.0 00000100:00100000:0.0:1782241327.369080:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241327.369120:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140025088 00000100:00100000:0.0:1782241327.369123:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140025088 00000100:00100000:0.0:1782241327.369150:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1782241327.369155:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140025088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241327.369197:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140025088:12345-0@lo:400:kworker.0 Request processed in 41us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241327.369203:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1782241327.369230:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140025088:0@lo:400:kworker.0 00000100:00100000:0.0:1782241327.369264:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140025472:0@lo:400:kworker.0 00000100:00100000:3.0:1782241327.369401:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140024448 00000100:00100000:3.0:1782241327.369406:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140024448 00000100:00100000:3.0:1782241327.369434:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1782241327.369441:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815140024448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241327.369475:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:62797b42-772f-434f-be35-dfdfcff291e0+24:3637:x1868815140024448:12345-0@lo:400:kworker.0 Request processed in 34us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241327.369481:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1782241327.369513:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140024704:0@lo:400:kworker.0 00000100:00100000:3.0:1782241327.369537:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241327.369557:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815140025216:0@lo:400:kworker.0 00000100:00100000:3.0:1782241327.369579:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241327.369598:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782241327.369604:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140024832:0@lo:400:kworker.0 00000100:00100000:3.0:1782241327.369624:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241327.369640:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140025344:0@lo:400:kworker.0 00000100:00100000:3.0:1782241327.369669:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241327.369694:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140024704 00000100:00100000:3.0:1782241327.369698:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140024704 00000100:00100000:3.0:1782241327.369721:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140025216 00000100:00100000:3.0:1782241327.369723:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140025216 00000100:00100000:3.0:1782241327.369742:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140025344 00000100:00100000:3.0:1782241327.369745:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140025344 00000100:00100000:3.0:1782241327.369777:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1782241327.369783:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140024704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241327.369828:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140024704:12345-0@lo:400:kworker.0 Request processed in 45us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241327.369842:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1782241327.369856:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1782241327.369862:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815140025216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241327.369892:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815140025216:12345-0@lo:400:kworker.0 Request processed in 30us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241327.369897:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1782241327.370816:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241327.370878:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:62797b42-772f-434f-be35-dfdfcff291e0:3637:1868815140024448:0@lo:400:kworker.0 00000100:00100000:0.0:1782241327.371353:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140025472 00000100:00100000:0.0:1782241327.371360:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140025472 00000100:00100000:0.0:1782241327.371414:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782241327.371422:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140025472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241327.371490:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140025472:12345-0@lo:400:kworker.0 Request processed in 69us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241327.371496:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782241327.371546:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140025472:0@lo:400:kworker.0 00000100:00100000:0.0:1782241327.371942:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241327.371954:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140025600:0@lo:400:kworker.0 00000100:00100000:0.0:1782241327.371991:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241327.372027:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140025600 00000100:00100000:0.0:1782241327.372031:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140025600 00000100:00100000:0.0:1782241327.372060:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782241327.372066:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140025600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241327.372116:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140025600:12345-0@lo:400:kworker.0 Request processed in 50us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241327.372122:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782241327.372155:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140025600:0@lo:400:kworker.0 00000100:00100000:0.0:1782241327.372208:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140025984:0@lo:400:kworker.0 00000100:00100000:1.0:1782241327.372229:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140025856:0@lo:400:kworker.0 00000100:00100000:0.0:1782241327.372231:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241327.372261:0:8746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140025984 00000100:00100000:1.0:1782241327.372262:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241327.372264:0:8746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140025984 00000100:00100000:1.0:1782241327.372275:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782241327.372280:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815140025728:0@lo:400:kworker.0 00000100:00100000:1.0:1782241327.372301:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241327.372582:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1782241327.372596:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140025344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241327.372642:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140025344:12345-0@lo:400:kworker.0 Request processed in 50us (2972us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241327.372649:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1782241327.372669:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140025856 00000100:00100000:3.0:1782241327.372672:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140025856 00000100:00100000:3.0:1782241327.372687:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140025728 00000100:00100000:3.0:1782241327.372689:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140025728 00000100:00100000:3.0:1782241327.372703:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1782241327.372707:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815140025856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241327.372743:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1868815140025856:12345-0@lo:400:kworker.0 Request processed in 35us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241327.372749:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1782241327.372776:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1782241327.372782:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815140025728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241327.372811:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815140025728:12345-0@lo:400:kworker.0 Request processed in 29us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241327.372817:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1782241327.372864:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140024832 00000100:00100000:3.0:1782241327.372868:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140024832 00000100:00100000:3.0:1782241327.379229:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1782241327.379252:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140024832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241327.379387:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140024832:12345-0@lo:400:kworker.0 Request processed in 144us (9761us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241327.379396:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1782241327.380644:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815140025728:0@lo:400:kworker.0 00010000:00080000:3.0:1782241327.380668:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d45a49500 x1868815140025856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241327.380682:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140025856:0@lo:400:kworker.0 00000100:00080000:3.0:1782241327.381186:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782241327.381194:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782241327.381199:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782241327.381202:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782241327.381235:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140024832:0@lo:400:kworker.0 00010000:00080000:3.0:1782241327.381252:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d45a49180 x1868815140025344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241327.381263:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140025344:0@lo:400:kworker.0 00000100:00100000:3.0:1782241327.381279:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140024704:0@lo:400:kworker.0 00000100:00100000:3.0:1782241327.381293:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815140025216:0@lo:400:kworker.0 00000100:00100000:0.0:1782241327.385481:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782241327.385515:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140025984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241327.386822:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140025984:12345-0@lo:400:kworker.0 Request processed in 1319us (14582us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241327.386835:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782241327.397381:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140025984:0@lo:400:kworker.0 00010000:00010000:3.0:1782241327.749655:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241327.879911:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140026112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241327.880032:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241327.880322:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140026112 00000100:00100000:1.0:1782241327.880333:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140026112 00000100:00100000:1.0:1782241327.880402:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1782241327.880414:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140026112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241327.880463:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782241327.880522:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140026112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241327.880530:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1782241327.881822:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140026112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241327.882965:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782241327.882982:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140026240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782241327.883067:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241327.883173:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140026240 00000100:00100000:0.0:1782241327.883181:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140026240 00000100:00100000:0.0:1782241327.883235:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782241327.883245:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140026240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241327.883271:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782241327.883320:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140026240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241327.883328:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782241327.883370:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140026240:0@lo:13:osp-pre-1-1.0 00000020:01000004:1.0:1782241328.359874:0:15057:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1782241328.384121:0:15057:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1782241328.384208:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1974f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241328.384226:0:15057:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1974f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241328.384234:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1974f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241328.384241:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1974f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241328.385252:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782241328.385539:0:15057:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1782241328.385585:0:15057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782241328.385592:0:15057:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1782241328.385600:0:15057:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1782241328.385638:0:15057:0:(import.c:65:import_set_state_nolock()) ffff890e4599b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1782241328.385901:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241328.385912:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1974f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.385947:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e47180000 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241328.385951:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1974f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.385964:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1974f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241328.385972:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1974f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241328.385977:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782241328.385980:0:8441:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1782241328.385983:0:8441:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1782241328.386017:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1974f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.386023:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241328.386045:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1974f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.386053:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e47180000/0xc9959f2fb1e19748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1974f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.386066:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241328.386068:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241328.386070:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241328.386131:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241328.386158:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815140026496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241328.386247:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241328.386404:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4836c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1868815140026368:0@lo:39:umount.0 00000100:00100000:2.0:1782241328.386441:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241328.386533:0:10147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140026368 00000100:00100000:2.0:1782241328.386543:0:10147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140026368 00000100:00100000:2.0:1782241328.386821:0:10147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1782241328.386831:0:10147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1868815140026368:12345-0@lo:39:umount.0 00000020:00000080:2.0:1782241328.387003:0:10147:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e192b7 00000100:00080000:2.0:1782241328.387013:0:10147:0:(import.c:65:import_set_state_nolock()) ffff890e81409000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1782241328.387106:0:10147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3636:x1868815140026368:12345-0@lo:39:umount.0 Request processed in 275us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241328.387115:0:10147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1782241328.387130:0:10147:0:(genops.c:906:class_export_put()) final put ffff890e8140f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1782241328.387168:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e8140f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1782241328.387219:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e81409000 for lustre-MDT0000 00000100:00100000:1.0:1782241328.387543:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140026496 00000100:00100000:1.0:1782241328.387551:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140026496 00000100:00100000:1.0:1782241328.387612:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782241328.387621:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62797b42-772f-434f-be35-dfdfcff291e0+24:3639:x1868815140026496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241328.387651:0:10331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241328.387672:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b860600/0xc9959f2fb1e1974f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e19748 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.387688:0:10331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241328.387730:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:62797b42-772f-434f-be35-dfdfcff291e0+23:3639:x1868815140026496:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241328.387736:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782241328.387789:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815140026496:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782241328.387955:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782241328.388012:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e4599b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1782241328.388038:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4836c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1868815140026368:0@lo:39:umount.0 00000100:00080000:3.0:1782241328.388102:0:15057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782241328.388108:0:15057:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1782241328.388113:0:15057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1782241328.391371:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1975d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241328.391926:0:15057:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1975d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241328.391935:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1975d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241328.391942:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1975d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241328.391996:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241328.392005:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241328.392035:0:15057:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241328.392041:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e19661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241328.392048:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e19661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.392090:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782241328.392099:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1975d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.392107:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e47181800 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241328.392111:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1975d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.392122:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1975d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241328.392129:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1975d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241328.392135:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782241328.392138:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1782241328.392181:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1975d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.392188:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241328.392235:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1975d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.392243:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e47181800/0xc9959f2fb1e19756 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1975d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.392258:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241328.392266:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e19661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.392273:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c2200 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241328.392276:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e19661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.392283:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e19661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241328.392290:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e19661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241328.392295:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1782241328.392297:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000100:00100000:3.0:1782241328.392302:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1782241328.392311:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e19661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.392316:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241328.392321:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e19661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241328.392327:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140026624:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241328.392327:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241328.392329:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241328.392336:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241328.392425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241328.392492:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140026752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782241328.392565:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140026624 00000100:00100000:3.0:1782241328.392568:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241328.392573:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140026624 00000100:00100000:1.0:1782241328.393096:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140026752 00000100:00100000:1.0:1782241328.393101:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140026752 00000100:00100000:1.0:1782241328.393128:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782241328.393137:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+24:3638:x1868815140026624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241328.393155:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241328.393171:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e82057c00/0xc9959f2fb1e1975d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e19756 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.393188:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241328.393231:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+23:3638:x1868815140026624:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241328.393240:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782241328.393260:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782241328.393273:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140026624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782241328.393362:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782241328.393370:0:15057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e821c2200/0xc9959f2fb1e1965a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e19661 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241328.393398:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241328.393465:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+22:3638:x1868815140026752:12345-0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1782241328.393470:0:15057:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1782241328.393474:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241328.393483:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e19661 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1965a expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241328.393492:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782241328.393498:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e199b7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241328.393506:0:15057:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e199b7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241328.393513:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e199b7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241328.393521:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e199b7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241328.393525:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:62797b42-772f-434f-be35-dfdfcff291e0+21:3638:x1868815140026752:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (957us total) trans 0 rc 0/0 00010000:00010000:0.0:1782241328.393536:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241328.393543:0:15057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e82056600/0xc9959f2fb1e19216 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1921d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241328.393572:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140026752:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782241328.393628:0:15057:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e82056600/0xc9959f2fb1e19216 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1921d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241328.393636:0:15057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e82056600/0xc9959f2fb1e19216 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1921d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241328.393643:0:15057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e82056600/0xc9959f2fb1e19216 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1921d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241328.393663:0:15057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1782241328.393667:0:15057:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1782241328.393671:0:15057:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1782241328.393687:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241328.393693:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e199b7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241328.393709:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac400 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241328.393712:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e199b7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241328.393720:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e199b7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241328.393727:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e199b7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241328.393733:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1782241328.393735:0:8440:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1782241328.393737:0:8440:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1782241328.393776:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e199b7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241328.393783:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241328.393806:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e199b7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241328.393814:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e43fac400/0xc9959f2fb1e199b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e199b7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241328.393830:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241328.393833:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e82056600/0xc9959f2fb1e19216 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1921d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241328.393839:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e82056600 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241328.393842:0:8440:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e82056600/0xc9959f2fb1e19216 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1921d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241328.393849:0:8440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e82056600/0xc9959f2fb1e19216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1921d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241328.393855:0:8440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e82056600/0xc9959f2fb1e19216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1921d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241328.393860:0:8440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1782241328.393863:0:8440:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1782241328.393865:0:8440:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1782241328.393878:0:8440:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e82056600/0xc9959f2fb1e19216 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1921d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241328.393884:0:8440:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241328.393891:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e82056600/0xc9959f2fb1e19216 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1921d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241328.393897:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e82056600/0xc9959f2fb1e19216 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1921d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241328.393906:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241328.393908:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241328.393915:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241328.393939:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815140027008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241328.393979:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241328.394024:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140027008 00000100:00100000:3.0:1782241328.394028:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140027008 00000100:00100000:0.0:1782241328.394049:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782241328.394055:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815140026880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241328.394090:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241328.394114:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140026880 00000100:00100000:2.0:1782241328.394118:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140026880 00000020:01000004:0.0:1782241328.394127:0:15057:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1782241328.394131:0:15057:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1782241328.394138:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000100:00100000:2.0:1782241328.394144:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000020:00000080:0.0:1782241328.394146:0:15057:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000100:00100000:2.0:1782241328.394150:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62797b42-772f-434f-be35-dfdfcff291e0+23:3640:x1868815140026880:12345-0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1782241328.394152:0:15057:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff890e77a74000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1782241328.394158:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:0.0:1782241328.394158:0:15057:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff890d45a42000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782241328.394164:0:15057:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff890e7d549800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1782241328.394168:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e43facc00/0xc9959f2fb1e199b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e199b0 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782241328.394168:0:15057:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff890e7d52e000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1782241328.394174:0:15057:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff890e43fecd40) has exports, disconnecting them 00010000:00010000:2.0:1782241328.394178:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1782241328.394185:0:15057:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff890e77a74000), last request at 1782241327 00000020:00000080:0.0:1782241328.394194:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e195c7 00000100:00080000:0.0:1782241328.394213:0:15057:0:(import.c:65:import_set_state_nolock()) ffff890e77a71000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1782241328.394217:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:62797b42-772f-434f-be35-dfdfcff291e0+22:3640:x1868815140026880:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241328.394224:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782241328.394250:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815140026880:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1782241328.394264:0:15057:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890e77a74000): rc 0 00000020:00000080:0.0:1782241328.394267:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e77a74000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1782241328.394277:0:15057:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff890d45a42000), last request at 1782241327 00000020:00000080:2.0:1782241328.394281:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e77a74000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1782241328.394281:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e194a1 00000100:00080000:0.0:1782241328.394286:0:15057:0:(import.c:65:import_set_state_nolock()) ffff890d45a47800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1782241328.394296:0:15057:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890d45a42000): rc 0 00000020:00000080:0.0:1782241328.394298:0:15057:0:(genops.c:906:class_export_put()) final put ffff890d45a42000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1782241328.394302:0:15057:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff890e7d549800), last request at 1782241100 00000020:00000080:0.0:1782241328.394304:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1939e 00000100:00080000:0.0:1782241328.394307:0:15057:0:(import.c:65:import_set_state_nolock()) ffff890e7d54c000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1782241328.394317:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782241328.394321:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e77a71000 for lustre-MDT0000 00000020:00080000:0.0:1782241328.394323:0:15057:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890e7d549800): rc 0 00000020:00000080:0.0:1782241328.394325:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e7d549800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1782241328.394326:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890d45a42000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00080000:0.0:1782241328.394329:0:15057:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff890e7d52e000), last request at 1782241100 00000020:00000080:0.0:1782241328.394332:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19366 00000100:00080000:0.0:1782241328.394335:0:15057:0:(import.c:65:import_set_state_nolock()) ffff890e7d54b800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1782241328.394342:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1782241328.394349:0:15057:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967530 00000020:00000080:2.0:1782241328.394353:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d549800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1782241328.394379:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d45a47800 for lustre-MDT0000 00000020:00000080:2.0:1782241328.394383:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e7d54c000 for lustre-MDT0000 00000100:00100000:1.0:1782241328.394477:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1782241328.394502:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241328.394512:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241328.394649:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782241328.394659:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+20:3640:x1868815140027008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782241328.394668:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241328.394678:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e82057a00/0xc9959f2fb1e1921d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e19216 expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241328.394689:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241328.394791:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62797b42-772f-434f-be35-dfdfcff291e0+19:3640:x1868815140027008:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241328.394798:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782241328.394943:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:3640:1868815140027008:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782241328.395042:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1782241328.395347:0:15057:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890e7d52e000): rc 0 00000004:00000080:0.0:1782241328.395356:0:15057:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa60ac7ab7ae0 00000100:00080000:0.0:1782241328.395380:0:15057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1782241328.395385:0:15057:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1782241328.396596:0:15057:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1782241328.396634:0:15057:0:(import.c:65:import_set_state_nolock()) ffff890e7d75c000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1782241328.397338:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140027136:0@lo:39:umount.0 00000100:00100000:1.0:1782241328.397422:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241328.397569:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140027136 00000100:00100000:2.0:1782241328.397578:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140027136 00000100:00100000:2.0:1782241328.397634:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1782241328.397644:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1868815140027136:12345-0@lo:39:umount.0 00000020:00000080:2.0:1782241328.397682:0:7836:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e193f9 00000100:00080000:2.0:1782241328.397692:0:7836:0:(import.c:65:import_set_state_nolock()) ffff890e81720800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782241328.398446:0:7836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1782241328.398667:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3636:x1868815140027136:12345-0@lo:39:umount.0 Request processed in 1022us (1244us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782241328.398678:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00010000:00010000:3.0:1782241328.398772:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782241328.398845:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7d75c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1782241328.398855:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140027136:0@lo:39:umount.0 00000100:00080000:0.0:1782241328.399108:0:15057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1782241328.399120:0:15057:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1782241328.399140:0:15057:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1782241328.399209:0:15057:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1782241328.399231:0:15057:0:(import.c:65:import_set_state_nolock()) ffff890d46926800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1782241328.399361:0:15057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1782241328.399364:0:15057:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1782241328.399380:0:15057:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1782241328.399442:0:15057:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1782241328.399454:0:15057:0:(import.c:65:import_set_state_nolock()) ffff890d4797a000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1782241328.399487:0:15057:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff890e43fecd40) has no exports 00000100:00100000:1.0:1782241328.399801:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140027264:0@lo:9:umount.0 00000100:00100000:1.0:1782241328.399852:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241328.399880:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140027392:0@lo:9:umount.0 00000100:00100000:1.0:1782241328.399899:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241328.399934:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140027264 00000100:00100000:1.0:1782241328.399941:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140027264 00000100:00100000:1.0:1782241328.399981:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140027392 00000100:00100000:1.0:1782241328.399983:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140027392 00000100:00100000:1.0:1782241328.400004:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782241328.400011:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1868815140027264:12345-0@lo:9:umount.0 00000020:00000080:1.0:1782241328.400037:0:8426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19549 00000100:00080000:1.0:1782241328.400045:0:8426:0:(import.c:65:import_set_state_nolock()) ffff890d45a60000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782241328.400098:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1782241328.400198:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3636:x1868815140027264:12345-0@lo:9:umount.0 Request processed in 187us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241328.400206:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782241328.400220:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782241328.400226:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1868815140027392:12345-0@lo:9:umount.0 00000020:00000080:1.0:1782241328.400237:0:8426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19699 00000100:00080000:1.0:1782241328.400243:0:8426:0:(import.c:65:import_set_state_nolock()) ffff890d4797d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782241328.400332:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1782241328.400402:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3636:x1868815140027392:12345-0@lo:9:umount.0 Request processed in 176us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241328.400419:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:1.0:1782241328.400445:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241328.400451:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782241328.400477:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d46926800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1782241328.400487:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1782241328.400489:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782241328.400492:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140027264:0@lo:9:umount.0 00000100:00080000:1.0:1782241328.400502:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d4797a000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1782241328.400505:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1782241328.400506:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782241328.400509:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140027392:0@lo:9:umount.0 00000020:00080000:0.0:1782241328.408376:0:15057:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff890e43fecd40) has no exports 00000020:00000080:0.0:1782241328.466256:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19271 00000020:00000080:0.0:1782241328.466272:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e7c69e800/lustre-QMT0000_UUID 00000020:01000000:0.0:1782241328.466291:0:15057:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1782241328.466374:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7c69e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1782241328.469054:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782241328.469071:0:15057:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782241328.469076:0:15057:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff890e7c693380) has no exports 00000020:00000080:1.0:1782241328.469566:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1926a 00000020:00000080:1.0:1782241328.469576:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e4cf0d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782241328.469744:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e4cf0d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1782241328.469948:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782241328.469957:0:15057:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1782241328.469961:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e43f73800/lustre-QMT0000_UUID 00000020:00000080:1.0:1782241328.469963:0:15057:0:(genops.c:865:class_export_destroy()) destroying export ffff890e43f73800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1782241328.469971:0:15057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1782241328.773031:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241329.414310:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140027520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241329.414410:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241329.414638:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140027520 00000100:00100000:1.0:1782241329.414648:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140027520 00000100:00100000:1.0:1782241329.414751:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1782241329.414798:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140027520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782241329.414840:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782241329.414897:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140027520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241329.414940:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782241329.415472:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140027520:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1782241329.415841:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782241329.797105:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782241329.933564:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782241329.933576:0:9506:0:(genops.c:906:class_export_put()) final put ffff890d47979000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1782241329.933618:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000020:00000080:2.0:1782241329.933621:0:9506:0:(genops.c:906:class_export_put()) final put ffff890e53bee000/8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000020:00000080:0.0:1782241329.933943:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47979000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1782241329.934003:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e53bee000/8052d7b9-50cc-405f-b8e0-5c9d863c1c52 for lustre-OST0001 00000020:00000080:0.0:1782241329.934026:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d4797d800 for lustre-OST0001 00000020:00000080:0.0:1782241329.934032:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e521be000 for lustre-OST0001 00000001:00100000:2.0:1782241329.934532:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782241329.934537:0:8419:0:(genops.c:906:class_export_put()) final put ffff890d45a63000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1782241329.934557:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000020:00000080:2.0:1782241329.934559:0:8419:0:(genops.c:906:class_export_put()) final put ffff890d46660800/8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000020:00000080:0.0:1782241329.934796:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890d45a63000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1782241329.934830:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890d46660800/8052d7b9-50cc-405f-b8e0-5c9d863c1c52 for lustre-OST0000 00000020:00000080:0.0:1782241329.934853:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d45a60000 for lustre-OST0000 00000020:00000080:0.0:1782241329.934857:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d46665000 for lustre-OST0000 00000001:00100000:1.0:1782241329.935024:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1782241329.935036:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1782241329.935040:0:7442:0:(genops.c:906:class_export_put()) final put ffff890e7d528000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1782241329.935062:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 863fc9a5-c349-42ab-bac8-b8fe4972688d 00000001:00080000:1.0:1782241329.935068:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1782241329.935070:0:7442:0:(genops.c:906:class_export_put()) final put ffff890d47b7a000/863fc9a5-c349-42ab-bac8-b8fe4972688d 00000001:00100000:1.0:1782241329.935076:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000001:00080000:1.0:1782241329.935080:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1782241329.935082:0:7442:0:(genops.c:906:class_export_put()) final put ffff890d47979800/8052d7b9-50cc-405f-b8e0-5c9d863c1c52 00000020:00000080:2.0:1782241329.935125:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d528000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1782241329.935165:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47b7a000/863fc9a5-c349-42ab-bac8-b8fe4972688d for lustre-MDT0001 00000020:00000080:2.0:1782241329.935198:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47979800/8052d7b9-50cc-405f-b8e0-5c9d863c1c52 for lustre-MDT0001 00000020:00000080:2.0:1782241329.935223:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e81720800 for lustre-MDT0001 00000020:00000080:2.0:1782241329.935226:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d47b7b800 for lustre-MDT0001 00000020:00000080:2.0:1782241329.935744:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d4797a800 for lustre-MDT0001 00000040:00080000:0.0:1782241330.309861:0:13786:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782241330.821684:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241331.461738:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241331.461806:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140027648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782241331.461906:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241331.463201:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140027648 00000100:00100000:0.0:1782241331.463228:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140027648 00000100:00100000:0.0:1782241331.463500:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1782241331.463511:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1868815140027648:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1782241331.463521:0:6516:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1782241331.463650:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1868815140027648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (1743us total) trans 0 rc -107/-107 00000100:00100000:0.0:1782241331.463658:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:02020000:2.0:1782241331.463735:0:3637:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1782241331.480525:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1782241331.480533:0:3637:0:(import.c:65:import_set_state_nolock()) ffff890e43f76000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1782241331.480538:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1782241331.497003:0:3637:0:(import.c:65:import_set_state_nolock()) ffff890e43f76000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782241331.497018:0:3637:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 164 00000100:00080000:2.0:1782241331.497041:0:3637:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff890e43f76000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241331.497305:0:3637:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d47b4fb80 x1868815140027776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782241331.498093:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140027776:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1782241331.498388:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241331.498515:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140027776 00000100:00100000:2.0:1782241331.498523:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140027776 00000100:00100000:2.0:1782241331.498559:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1782241331.498567:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1868815140027776:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1782241331.498584:0:7836:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1782241331.514863:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1868815140027776:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 16285us (16466us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782241331.514879:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:1.0:1782241331.519159:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e43f76000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241331.519326:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1782241331.519332:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140027776:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1782241331.848831:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782241332.485045:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782241332.485060:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1782241332.485063:0:468:0:(import.c:65:import_set_state_nolock()) ffff890e43f76000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241332.485072:0:468:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 394 00000100:00080000:0.0:1782241332.485078:0:468:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782241332.485084:0:468:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff890e43f76000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241332.485109:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a49500 x1868815140028032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782241332.485268:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140028032:0@lo:38:kworker.0 00000100:00100000:3.0:1782241332.485336:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241332.485339:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815140028416:0@lo:400:kworker.0 00000100:00100000:0.0:1782241332.485370:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241332.485414:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140028416 00000100:00100000:3.0:1782241332.485422:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140028416 00000100:00100000:1.0:1782241332.485521:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815140027904:0@lo:400:kworker.0 00000100:00100000:2.0:1782241332.485599:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140028160:0@lo:400:kworker.0 00000100:00100000:3.0:1782241332.485709:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1782241332.485720:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815140028416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241332.487235:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241332.487283:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140028544:0@lo:400:kworker.0 00000100:00100000:1.0:1782241332.487317:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241332.488481:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140027904 00000100:00100000:1.0:1782241332.488493:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140027904 00000100:00100000:1.0:1782241332.488693:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1782241332.488706:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7b80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+19:3639:x1868815140027904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241332.488944:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7b80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:62797b42-772f-434f-be35-dfdfcff291e0+19:3639:x1868815140027904:12345-0@lo:400:kworker.0 Request processed in 241us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241332.488953:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1782241332.488994:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140028032 00000100:00100000:1.0:1782241332.488998:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140028032 00000100:00100000:1.0:1782241332.489037:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1782241332.489043:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140028032:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1782241332.489062:0:6515:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1782241332.495606:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140028928:0@lo:400:kworker.0 00000100:00100000:0.0:1782241332.495676:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241332.495735:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782241332.495741:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815140028288:0@lo:400:kworker.0 00000100:00100000:0.0:1782241332.495778:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241332.495801:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815140028800:0@lo:400:kworker.0 00000100:00100000:0.0:1782241332.495820:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241332.495862:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140028544 00000100:00100000:0.0:1782241332.495869:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140028544 00000100:00100000:0.0:1782241332.495917:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140028928 00000100:00100000:0.0:1782241332.495933:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140028928 00000100:00100000:0.0:1782241332.495960:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782241332.495968:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140028544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241332.496039:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140028544:12345-0@lo:400:kworker.0 Request processed in 71us (8719us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241332.496046:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782241332.496063:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782241332.496069:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140028928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241332.496106:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140028928:12345-0@lo:400:kworker.0 Request processed in 36us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241332.496111:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782241332.496132:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140028288 00000100:00100000:0.0:1782241332.496135:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140028288 00000100:00100000:0.0:1782241332.496171:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140028800 00000100:00100000:0.0:1782241332.496174:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140028800 00000100:00100000:0.0:1782241332.496193:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1782241332.496199:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815140028800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241332.496235:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815140028800:12345-0@lo:400:kworker.0 Request processed in 36us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241332.496241:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1782241332.496252:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1782241332.496257:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1868815140028288:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1782241332.496262:0:6512:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1782241332.496289:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1868815140028288:12345-0@lo:400:kworker.0 Request processed in 31us (510us total) trans 0 rc -107/-107 00000100:00100000:0.0:1782241332.496295:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:0.0:1782241332.496328:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1782241332.496338:0:3638:0:(import.c:65:import_set_state_nolock()) ffff890d45a7f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1782241332.496343:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1782241332.496356:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:3639:1868815140027904:0@lo:400:kworker.0 00000100:00100000:1.0:1782241332.496374:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140028544:0@lo:400:kworker.0 00000100:00100000:1.0:1782241332.496439:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140028032:12345-0@lo:38:kworker.0 Request processed in 7394us (11102us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782241332.496448:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:1.0:1782241332.496639:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e43f76000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241332.496644:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1782241332.496648:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140028032:0@lo:38:kworker.0 00000100:00080000:1.0:1782241332.496678:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241332.496682:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782241332.496685:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782241332.498536:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241332.498585:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815140028672:0@lo:400:kworker.0 00000100:00100000:2.0:1782241332.498805:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241332.498848:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140028160 00000100:00100000:2.0:1782241332.498854:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140028160 00000100:00100000:2.0:1782241332.498898:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140028672 00000100:00100000:2.0:1782241332.498901:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140028672 00000100:00100000:2.0:1782241332.498920:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1782241332.498927:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1868815140028160:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1782241332.498934:0:6510:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1782241332.498973:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1868815140028160:12345-0@lo:400:kworker.0 Request processed in 45us (441us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782241332.498980:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1782241332.498995:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1782241332.499010:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1868815140028672:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1782241332.499029:0:6510:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1782241332.499055:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1868815140028672:12345-0@lo:400:kworker.0 Request processed in 53us (250us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782241332.499061:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1782241332.499098:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1782241332.499102:0:3640:0:(import.c:65:import_set_state_nolock()) ffff890e7d54f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1782241332.499106:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1782241332.499111:0:3640:0:(import.c:65:import_set_state_nolock()) ffff890e7d54f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782241332.499114:0:3640:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 164 00000100:00080000:2.0:1782241332.499120:0:3640:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff890e7d54f800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241332.499150:0:3640:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d47b4dc00 x1868815140029056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782241332.499173:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140028160:0@lo:400:kworker.0 00000100:00080000:2.0:1782241332.499183:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1782241332.499186:0:3640:0:(import.c:65:import_set_state_nolock()) ffff890d47595800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1782241332.499189:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1782241332.499202:0:3640:0:(import.c:65:import_set_state_nolock()) ffff890d47595800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782241332.499205:0:3640:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 203 00000100:00080000:2.0:1782241332.499209:0:3640:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff890d47595800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241332.499221:0:3640:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d47b4df80 x1868815140029184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782241332.499232:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815140028672:0@lo:400:kworker.0 00000100:00100000:2.0:1782241332.499257:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1868815140029056:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1782241332.499291:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241332.499308:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815140029184:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1782241332.499330:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241332.499352:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140029056 00000100:00100000:2.0:1782241332.499356:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140029056 00000100:00100000:2.0:1782241332.499369:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140029184 00000100:00100000:2.0:1782241332.499371:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140029184 00000100:00100000:2.0:1782241332.499379:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1782241332.499382:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4836c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140029056:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1782241332.499396:0:6510:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1782241332.499424:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4836c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140029056:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 40us (132us total) trans 0 rc -19/-19 00000100:00100000:2.0:1782241332.499429:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1782241332.499440:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1782241332.499444:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140029184:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1782241332.499451:0:6510:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1782241332.499860:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815140028416:12345-0@lo:400:kworker.0 Request processed in 14140us (14486us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241332.499889:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00080000:3.0:1782241332.500029:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7d54f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782241332.500034:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782241332.500037:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1868815140029056:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1782241332.500776:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140029184:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 1327us (1442us total) trans 0 rc -19/-19 00000100:00100000:2.0:1782241332.500785:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1782241332.500991:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d47595800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782241332.500995:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782241332.501009:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815140029184:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1782241332.533750:0:3638:0:(import.c:65:import_set_state_nolock()) ffff890d45a7f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241332.535298:0:3638:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 182 00000100:00080000:0.0:1782241332.535309:0:3638:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff890d45a7f800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241332.535376:0:3638:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48038380 x1868815140029312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782241332.535411:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1868815140028288:0@lo:400:kworker.0 00010000:00080000:0.0:1782241332.535447:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48039880 x1868815140028800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241332.535458:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815140028800:0@lo:400:kworker.0 00010000:00080000:0.0:1782241332.535583:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d45a48380 x1868815140028416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241332.535603:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815140028416:0@lo:400:kworker.0 00000100:00100000:0.0:1782241332.535623:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140028928:0@lo:400:kworker.0 00000100:00100000:3.0:1782241332.535791:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1868815140029312:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1782241332.535859:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241332.536090:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140029312 00000100:00100000:0.0:1782241332.536097:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140029312 00000100:00100000:0.0:1782241332.537129:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1782241332.537138:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1868815140029312:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1782241332.537156:0:6511:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1782241332.537260:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1868815140029312:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 121us (1400us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782241332.537267:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1782241332.537358:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d45a7f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782241332.537364:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782241332.537368:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1868815140029312:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:3.0:1782241332.869364:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241332.997251:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782241332.997379:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140029440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241332.997452:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241332.997696:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140029440 00000100:00100000:0.0:1782241332.997705:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140029440 00000100:00100000:0.0:1782241332.997802:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782241332.997811:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140029440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241332.997843:0:14428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782241332.997918:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140029440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241332.997924:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782241332.998011:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140029440:0@lo:13:osp-pre-1-1.0 00000001:00100000:3.0:1782241333.512272:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1782241333.512283:0:6489:0:(genops.c:906:class_export_put()) final put ffff890e7d52e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1782241333.512405:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d52e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1782241333.515091:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e7d54b800 for lustre-MDT0000 00010000:00010000:3.0:1782241333.893482:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1782241334.534838:0:15057:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890d468883c0 - data ffff890e78ecaa20/ffff890d47917c00 00000020:01000000:0.0:1782241334.535022:0:15057:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890e8145e4e0 - data ffff890e78da80d8/ffff890e814b3400 00000100:00100000:1.0:1782241334.536205:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241334.536244:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140029568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241334.536357:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241334.537569:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140029568 00000100:00100000:0.0:1782241334.537585:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140029568 00000100:00100000:0.0:1782241334.537716:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782241334.537728:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140029568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782241334.537795:0:8427:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782241334.537917:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140029568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 191us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241334.537925:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782241334.538038:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140029568:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1782241334.541087:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1782241334.542342:0:15057:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967530 00000100:00080000:1.0:1782241334.590620:0:15057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1782241334.590634:0:15057:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1782241334.590655:0:15057:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff890d45a4bb80 x1868815140027136/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1782241338 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241334.590704:0:15057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1782241334.593006:0:15057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782241334.593016:0:15057:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1782241334.593033:0:15057:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782241334.593035:0:15057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1782241334.593828:0:8744:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1782241334.593835:0:8744:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1782241334.593846:0:8744:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1782241334.596138:0:15057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1782241334.596148:0:15057:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1782241334.596620:0:15057:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782241334.596624:0:15057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1782241334.598094:0:9978:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1782241334.598104:0:9978:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1782241334.598122:0:9978:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1782241334.600804:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19239 00000020:00000080:1.0:1782241334.600817:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e43fd0800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782241334.600873:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e43fd0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782241334.607033:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1924e 00000020:00000080:3.0:1782241334.607056:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e43fd5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1782241334.607130:0:15057:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1782241334.607137:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241334.607157:0:15057:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782241334.607162:0:15057:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff890e436319c0) has no exports 00000004:01000000:3.0:1782241334.607438:0:15057:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1782241334.607448:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19684 00000020:00000080:3.0:1782241334.607459:0:15057:0:(genops.c:906:class_export_put()) final put ffff890d4797d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782241334.607542:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e43fd5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1782241334.607614:0:15057:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1782241334.607620:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241334.607644:0:15057:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782241334.607648:0:15057:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff890d46918000) has no exports 00000020:00000080:3.0:1782241334.607656:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1967d 00000020:00000080:3.0:1782241334.607663:0:15057:0:(genops.c:906:class_export_put()) final put ffff890d47978000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782241334.607686:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890d4797d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1782241334.608514:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47978000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1782241334.608603:0:15057:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1782241334.608611:0:15057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1782241334.608618:0:15057:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1782241334.608628:0:15057:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782241334.608631:0:15057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782241334.608819:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241334.608833:0:15057:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782241334.608843:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19542 00000020:00000080:3.0:1782241334.608852:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e43f8d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782241334.608911:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d4797a000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1782241334.608921:0:468:0:(genops.c:906:class_export_put()) final put ffff890d4797e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782241334.608924:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890d4797e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1782241334.608934:0:468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1782241334.609233:0:15057:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1782241334.609240:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241334.609249:0:15057:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782241334.609254:0:15057:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff890d4691b380) has no exports 00000020:00000080:3.0:1782241334.609263:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1953b 00000020:00000080:3.0:1782241334.609269:0:15057:0:(genops.c:906:class_export_put()) final put ffff890d46920800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782241334.609293:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e43f8d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1782241334.611728:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890d46920800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1782241334.613416:0:15057:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1782241334.613426:0:15057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1782241334.613432:0:15057:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1782241334.613442:0:15057:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782241334.613445:0:15057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782241334.613506:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241334.613510:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d46926800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1782241334.613526:0:15057:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782241334.613534:0:15057:0:(genops.c:906:class_export_put()) final put ffff890d45a41000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782241334.613539:0:15057:0:(genops.c:865:class_export_destroy()) destroying export ffff890d45a41000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1782241334.613550:0:15057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1782241334.613697:0:15057:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1782241334.613707:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e193f2 00000020:00000080:3.0:1782241334.613716:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e8140f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1782241334.613741:0:15057:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1782241334.613746:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241334.613754:0:15057:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:2.0:1782241334.613775:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e8140f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00080000:3.0:1782241334.613777:0:15057:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff890e817419c0) has no exports 00000020:00000080:3.0:1782241334.613790:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e193eb 00000020:00000080:3.0:1782241334.613796:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e436dc800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782241334.613811:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e436dc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1782241334.627859:0:15057:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1782241334.627872:0:15057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1782241334.627883:0:15057:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1782241334.627895:0:15057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782241334.627944:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e7d75c000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1782241334.628005:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241334.628019:0:15057:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782241334.628023:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e8174c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782241334.628027:0:15057:0:(genops.c:865:class_export_destroy()) destroying export ffff890e8174c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1782241334.628056:0:15057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782241334.628169:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241334.628173:0:15057:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782241334.628176:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e4599a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782241334.628178:0:15057:0:(genops.c:865:class_export_destroy()) destroying export ffff890e4599a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1782241334.628183:0:15057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782241334.628237:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19255 00000020:00000080:2.0:1782241334.628245:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e43fd7000/lustre-MDD0000_UUID 00000020:01000000:2.0:1782241334.628261:0:15057:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1782241334.628266:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782241334.628272:0:15057:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782241334.628276:0:15057:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff890e43fe8000) has no exports 00000020:00000080:2.0:1782241334.628300:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241334.628303:0:15057:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1782241334.628308:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1925c 00000020:00000080:2.0:1782241334.628312:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e43fd1800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1782241334.628321:0:15057:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e48138000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1782241334.628324:0:15057:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e48138000 3 00000020:01000004:2.0:1782241334.628328:0:15057:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff890e48138000 from lustre-MDT0000 00000020:00000080:2.0:1782241334.628345:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241334.628348:0:15057:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1782241334.628351:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e43fd4800/lustre-MDT0000_UUID 00000020:00000080:2.0:1782241334.628353:0:15057:0:(genops.c:865:class_export_destroy()) destroying export ffff890e43fd4800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1782241334.628359:0:15057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:1.0:1782241334.628394:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e43fd7000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1782241334.628407:0:468:0:(genops.c:906:class_export_put()) final put ffff890e43fd7800/lustre-MDD0000_UUID 00000020:01000004:2.0:1782241334.628409:0:15057:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:00000080:1.0:1782241334.628411:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e43fd7800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:2.0:1782241334.628416:0:15057:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1782241334.628423:0:15057:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:01000000:1.0:1782241334.628426:0:468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1782241334.628427:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782241334.628434:0:15057:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782241334.628443:0:15057:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff890e5066b000 62797b42-772f-434f-be35-dfdfcff291e0 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782241334.628448:0:15057:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff890e43630000) has exports, disconnecting them 00000020:00080000:2.0:1782241334.628460:0:15057:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff890e5066b000), last request at 1782241083 00000020:00000080:2.0:1782241334.628478:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e191fa 00000020:00010000:2.0:1782241334.628485:0:15057:0:(genops.c:1942:obd_stale_export_put()) Put export ffff890e5066b000: total 2 00000100:00080000:2.0:1782241334.628491:0:15057:0:(import.c:65:import_set_state_nolock()) ffff890e50668000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1782241334.628510:0:15057:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890e5066b000): rc 0 00000020:00080000:2.0:1782241334.628515:0:15057:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff890e43630000) has no exports 00000020:00000080:1.0:1782241334.628518:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e43fd1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1782241334.628539:0:8441:0:(genops.c:1928:obd_stale_export_get()) Get export ffff890e5066b000: total 0 00010000:00010000:1.0:1782241334.628563:0:8441:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff890e5066b000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1782241334.628607:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e47180800/0xc9959f2fb1e19725 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1971e expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241334.628628:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e47180e00/0xc9959f2fb1e19733 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1972c expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241334.628640:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e82056a00/0xc9959f2fb1e192f6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e192ef expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241334.628657:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164cc00/0xc9959f2fb1e19304 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e192fd expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241334.628693:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e47180a00/0xc9959f2fb1e1998d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e19986 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241334.628708:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e47181000/0xc9959f2fb1e19741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e1973a expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241334.628726:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e82057e00/0xc9959f2fb1e196fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e196f4 expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241334.628736:0:6503:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff890e6df2ba00:6503] 0 exiting: rc = 1 00010000:00010000:1.0:1782241334.628744:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e778f0400/0xc9959f2fb1e199a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e199a2 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241334.628781:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e43fad000/0xc9959f2fb1e1999b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e19994 expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241334.628799:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1976b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e19764 expref: 5 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241334.628810:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e19709 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e19702 expref: 4 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241334.628820:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e47181400/0xc9959f2fb1e1961b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e19614 expref: 3 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241334.628831:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e82056c00/0xc9959f2fb1e19717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9959f2fb1e19710 expref: 2 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241334.628843:0:8441:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff890e5066b000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1782241334.628857:0:8441:0:(genops.c:906:class_export_put()) final put ffff890e5066b000/62797b42-772f-434f-be35-dfdfcff291e0 00010000:00010000:1.0:1782241334.628944:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241334.628952:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241334.628954:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241334.628996:0:6504:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff890e7b8ab000:6504] 1 exiting: rc = 0 00000100:00100000:1.0:1782241334.629057:0:6505:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff890e7b8aa200:6505] 2 exiting: rc = 0 00000020:00000080:2.0:1782241334.630030:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e5066b000/62797b42-772f-434f-be35-dfdfcff291e0 for MGS 00000100:00100000:3.0:1782241334.630145:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630158:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630165:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630173:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630180:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630186:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630196:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630204:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630211:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630217:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630224:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630232:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630239:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630245:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630253:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630259:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630266:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630273:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630279:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630285:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630292:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630298:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630307:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630314:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630321:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630327:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630333:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630353:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630360:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630366:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630373:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630378:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1782241334.630378:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e50668000 for MGS 00000100:00100000:3.0:1782241334.630384:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630391:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630397:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630404:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630409:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630415:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630422:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630427:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630433:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630438:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630445:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630451:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630457:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630463:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630469:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630474:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630480:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630486:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630491:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630497:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630503:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630509:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630515:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630522:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630528:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630534:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630540:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630633:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630640:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630646:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630660:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241334.630665:0:15057:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1782241334.631623:0:15057:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890d418df8a0 - data ffff890e78dc2d80/ffff890d478a9000 00000020:01000000:3.0:1782241334.631708:0:15057:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890e467468a0 - data ffff890e78cce948/ffff890e6df7ac00 00000020:00000080:3.0:1782241334.632255:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e191de 00000020:00000080:3.0:1782241334.632267:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e47e18800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1782241334.632291:0:15057:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e48138000 from MGS, refs=2 00000020:01000004:3.0:1782241334.632295:0:15057:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e48138000 2 00000020:01000004:3.0:1782241334.632299:0:15057:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff890e48138000 from MGS 00000020:00000080:3.0:1782241334.632330:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241334.632338:0:15057:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1782241334.632340:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e47e1d000/MGS 00000020:00000080:2.0:1782241334.632341:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e47e18800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782241334.632343:0:15057:0:(genops.c:865:class_export_destroy()) destroying export ffff890e47e1d000/MGS for MGS 00000020:01000000:3.0:1782241334.632349:0:15057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1782241334.632443:0:15057:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1782241334.632448:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241334.632455:0:15057:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782241334.632463:0:15057:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff890e43fd2800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782241334.632469:0:15057:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff890e43feb380) has exports, disconnecting them 00000020:00080000:3.0:1782241334.632475:0:15057:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff890e43fd2800), last request at 1782241083 00000020:00000080:3.0:1782241334.632479:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e192a9 00000020:00080000:3.0:1782241334.632488:0:15057:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890e43fd2800): rc 0 00000020:00000080:3.0:1782241334.632493:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e43fd2800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1782241334.632523:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e43fd2800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1782241334.633203:0:15057:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1782241334.633209:0:15057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782241334.633214:0:15057:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782241334.633221:0:15057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782241334.633276:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e4599b000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1782241334.633344:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241334.633349:0:15057:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1782241334.633352:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e43fd6800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1782241334.633355:0:15057:0:(genops.c:865:class_export_destroy()) destroying export ffff890e43fd6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1782241334.633376:0:15057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1782241334.633440:0:15057:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e48138000 1 00000020:00000080:3.0:1782241334.633446:0:15057:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e191d0 00000020:00000080:3.0:1782241334.633450:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e47e1e000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1782241334.633465:0:15057:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1782241334.633469:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241334.633472:0:15057:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782241334.633475:0:15057:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff890e43634d40) has no exports 00000020:00000080:2.0:1782241334.633572:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff890e47e1e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1782241334.679917:0:15057:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782241334.679936:0:15057:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1782241334.679944:0:15057:0:(genops.c:906:class_export_put()) final put ffff890e42e77000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1782241334.679951:0:15057:0:(genops.c:865:class_export_destroy()) destroying export ffff890e42e77000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1782241334.679968:0:15057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1782241334.680301:0:15057:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff890e4813e800 00000020:02000400:1.0:1782241334.680392:0:15057:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1782241334.917303:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241335.943201:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241336.966855:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782241337.604973:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782241337.604981:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1782241337.604984:0:36:0:(import.c:65:import_set_state_nolock()) ffff890e43f76000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241337.604993:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 395 00000100:00080000:0.0:1782241337.604999:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1782241337.605005:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff890e43f76000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241337.605039:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d4803ad80 x1868815140029824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241337.605067:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782241337.605071:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1782241337.605073:0:36:0:(import.c:65:import_set_state_nolock()) ffff890e7d54f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241337.605076:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 395 00000100:00080000:0.0:1782241337.605079:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782241337.605083:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff890e7d54f800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241337.605095:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d4803b100 x1868815140029952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241337.605104:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782241337.605106:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1782241337.605108:0:36:0:(import.c:65:import_set_state_nolock()) ffff890d45a7f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241337.605111:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 395 00000100:00080000:0.0:1782241337.605113:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782241337.605116:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff890d45a7f800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241337.605125:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d4803b480 x1868815140030080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241337.605155:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782241337.605159:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1782241337.605161:0:36:0:(import.c:65:import_set_state_nolock()) ffff890d47595800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241337.605164:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 395 00000100:00080000:0.0:1782241337.605167:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782241337.605170:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff890d47595800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241337.605189:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48038a80 x1868815140030464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782241337.605230:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815140030208:0@lo:400:kworker.0 00000100:00100000:0.0:1782241337.605296:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241337.605367:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782241337.605373:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140029696:0@lo:400:kworker.0 00000400:00000100:0.0:1782241337.605395:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868815140029696 offset 0 length 224: 4 00000100:00100000:0.0:1782241337.605416:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140030720:0@lo:400:kworker.0 00000100:00100000:0.0:1782241337.605439:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241337.605470:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140029824:0@lo:38:kworker.0 00000100:00100000:0.0:1782241337.605496:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241337.605517:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1868815140029952:0@lo:38:kworker.0 00000100:00100000:0.0:1782241337.605536:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241337.605556:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1868815140030080:0@lo:38:kworker.0 00000100:00100000:0.0:1782241337.605575:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241337.605594:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815140030464:0@lo:38:kworker.0 00000100:00100000:0.0:1782241337.605613:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241337.605640:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140030336:0@lo:400:kworker.0 00000100:00100000:0.0:1782241337.605664:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241337.605684:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241337.605689:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140030592:0@lo:400:kworker.0 00000100:00100000:0.0:1782241337.605707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241337.605738:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140030720 00000100:00100000:0.0:1782241337.605745:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140030720 00000100:00100000:0.0:1782241337.605824:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140030336 00000100:00100000:0.0:1782241337.605827:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140030336 00000100:00100000:0.0:1782241337.605847:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782241337.605856:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140030720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241337.605923:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140030720:12345-0@lo:400:kworker.0 Request processed in 68us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241337.605930:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782241337.605946:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1782241337.605954:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140030336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241337.605988:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140030336:12345-0@lo:400:kworker.0 Request processed in 35us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241337.605994:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1782241337.606011:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140030208 00000100:00100000:0.0:1782241337.606014:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140030208 00000100:00100000:0.0:1782241337.606033:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140029952 00000100:00100000:0.0:1782241337.606036:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140029952 00000100:00100000:0.0:1782241337.606044:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140030080 00000100:00100000:0.0:1782241337.606046:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140030080 00000100:00100000:0.0:1782241337.606053:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140030464 00000100:00100000:0.0:1782241337.606055:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140030464 00000100:00100000:0.0:1782241337.606062:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140030592 00000100:00100000:0.0:1782241337.606064:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140030592 00000100:00100000:0.0:1782241337.606080:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1782241337.606085:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815140030208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241337.606121:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1868815140030208:12345-0@lo:400:kworker.0 Request processed in 35us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241337.606127:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1782241337.606139:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1782241337.606144:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815140030592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241337.606182:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815140030592:12345-0@lo:400:kworker.0 Request processed in 38us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241337.606188:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1782241337.606200:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1782241337.606204:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140029952:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1782241337.606221:0:6510:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1782241337.606259:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140029952:12345-0@lo:38:kworker.0 Request processed in 52us (720us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782241337.606265:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1782241337.606278:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1782241337.606283:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140030080:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1782241337.606293:0:6510:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1782241337.606303:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140029824 00000100:00100000:3.0:1782241337.606310:0:7836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140029824 00000100:00100000:0.0:1782241337.606323:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140030080:12345-0@lo:38:kworker.0 Request processed in 39us (746us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782241337.606330:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1782241337.606344:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1782241337.606350:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140030464:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1782241337.606355:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00010000:00020000:0.0:1782241337.606362:0:6510:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1782241337.606364:0:7836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1868815140029824:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1782241337.606379:0:7836:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1782241337.606393:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140030464:12345-0@lo:38:kworker.0 Request processed in 42us (778us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782241337.606400:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1782241337.606419:0:7836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1868815140029824:12345-0@lo:38:kworker.0 Request processed in 55us (922us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782241337.606427:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00010000:00080000:0.0:1782241337.606452:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff890d48039c00 x1868815140030592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241337.606467:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140030592:0@lo:400:kworker.0 00000100:00100000:0.0:1782241337.606491:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140030336:0@lo:400:kworker.0 00000100:00080000:0.0:1782241337.606523:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e43f76000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782241337.606529:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782241337.606532:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140029824:0@lo:38:kworker.0 00000100:00080000:0.0:1782241337.606539:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7d54f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782241337.606542:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782241337.606545:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1868815140029952:0@lo:38:kworker.0 00000100:00080000:0.0:1782241337.606552:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d45a7f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782241337.606555:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782241337.606558:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1868815140030080:0@lo:38:kworker.0 00000100:00080000:0.0:1782241337.606566:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d47595800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782241337.606569:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782241337.606572:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815140030464:0@lo:38:kworker.0 00000100:00100000:0.0:1782241337.606601:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140030720:0@lo:400:kworker.0 00010000:00080000:0.0:1782241337.606610:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff890d4803bb80 x1868815140030208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241337.606619:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1868815140030208:0@lo:400:kworker.0 00000100:00080000:0.0:1782241337.606653:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241337.606657:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782241337.606659:0:6506:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782241337.991918:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241338.117625:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140030848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241338.117709:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241338.123102:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140030848 00000100:00100000:0.0:1782241338.123115:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140030848 00000100:00100000:0.0:1782241338.123378:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782241338.123389:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140030848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782241338.123438:0:14428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782241338.123555:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140030848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 168us (5857us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241338.123563:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782241338.123661:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140030848:0@lo:13:osp-pre-1-1.0 00000020:01000004:1.0:1782241338.348693:0:15259:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1782241338.364990:0:15259:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1782241338.365072:0:15259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19733 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.365088:0:15259:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19733 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.365096:0:15259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e19733 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.365103:0:15259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e19733 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.365126:0:15259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782241338.365132:0:15259:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1782241338.365170:0:15259:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782241338.365186:0:15259:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1782241338.365192:0:15259:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782241338.365199:0:15259:0:(import.c:65:import_set_state_nolock()) ffff890e7d54f800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1782241338.365203:0:15259:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782241338.365205:0:15259:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782241338.365208:0:15259:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782241338.366742:0:15259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19741 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.366787:0:15259:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19741 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.366795:0:15259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e19741 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.366801:0:15259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e19741 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.366825:0:15259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782241338.366832:0:15259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1961b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.366838:0:15259:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1961b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.366844:0:15259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1961b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.366850:0:15259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1961b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.366880:0:15259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1782241338.366896:0:15259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e199a9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.366902:0:15259:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e199a9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.366908:0:15259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e199a9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.366914:0:15259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e199a9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.366929:0:15259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1782241338.366946:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1782241338.366952:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e19733 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.366960:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e82056200 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241338.366963:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e19733 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.366971:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e19733 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241338.366978:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e19733 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241338.366983:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782241338.366992:0:8441:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1782241338.366995:0:8441:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1782241338.367042:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e19733 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.367049:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241338.368297:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782241338.368320:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e19741 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241338.368329:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861400 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241338.368332:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e19741 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241338.368340:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e19741 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241338.368346:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e19741 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241338.368363:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782241338.368365:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1782241338.368395:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e19741 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241338.368400:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241338.368688:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e19733 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.368696:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e82056200/0xc9959f2fb1e1972c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e19733 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.368713:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782241338.368717:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1961b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.368723:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40031e00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241338.368726:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1961b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.368733:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1961b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241338.368739:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1961b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241338.368745:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1782241338.368747:0:8441:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1782241338.368750:0:8441:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1782241338.368782:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1961b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.368798:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241338.368816:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1961b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.368824:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e40031e00/0xc9959f2fb1e19614 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e1961b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.368841:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241338.368845:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e199a9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.368850:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac800 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241338.368854:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e199a9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.368860:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e199a9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241338.368867:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e199a9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241338.368873:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1782241338.368875:0:8441:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1782241338.368877:0:8441:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1782241338.368903:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e199a9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.368909:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241338.368915:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e199a9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.368931:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e43fac800/0xc9959f2fb1e199a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e199a9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.368940:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241338.368942:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241338.368944:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241338.368966:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140031360:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241338.369184:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241338.369390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241338.369458:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782241338.369466:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140031232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782241338.369490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241338.369522:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140031360 00000100:00100000:1.0:1782241338.369529:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140031360 00000100:00100000:1.0:1782241338.369557:0:10331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140031232 00000100:00100000:1.0:1782241338.369559:0:10331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140031232 00000100:00100000:1.0:1782241338.369578:0:10331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782241338.369584:0:10331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e436c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3638:x1868815140031360:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1782241338.369590:0:10331:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782241338 with bad export cookie 14525691200350032378 00000100:00100000:2.0:1782241338.370327:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782241338.370335:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1868815140031232:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1782241338.370341:0:6495:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782241338 with bad export cookie 14525691200350032378 00000100:00100000:2.0:1782241338.370413:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1868815140031232:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (920us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782241338.370420:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1782241338.370461:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.158@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1782241338.370467:0:3638:0:(import.c:65:import_set_state_nolock()) ffff890e47173000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1782241338.370471:0:3638:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1782241338.373010:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e19741 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241338.373158:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1973a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e19741 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241338.373178:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241338.373180:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241338.373183:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241338.373194:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241338.380115:0:10331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e436c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3638:x1868815140031360:12345-0@lo:103:ldlm_bl.0 Request processed in 10523us (10720us total) trans 0 rc -107/-107 00000100:00100000:1.0:1782241338.380129:0:10331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1782241338.380227:0:15259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e192fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19304 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.380240:0:15259:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e192fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19304 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.380266:0:15259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e192fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e19304 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.380273:0:15259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e192fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e19304 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.380291:0:15259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782241338.380297:0:15259:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1782241338.380301:0:15259:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:1.0:1782241338.380340:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241338.380346:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e192fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e19304 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.380353:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d400 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241338.380357:0:8441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e192fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e19304 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.380364:0:8441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e192fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e19304 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241338.380371:0:8441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e192fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e19304 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241338.380376:0:8441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1782241338.380379:0:8441:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1782241338.380380:0:8441:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:2.0:1782241338.395458:0:3638:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.158@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1782241338.395465:0:3638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1782241338.395494:0:3638:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890d48039880 x1868815140029696/t0(0) o400->MGC192.168.204.158@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1782241353 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241338.395510:0:3638:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890d47830e00 x1868815140031360/t0(0) o103->MGC192.168.204.158@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782241354 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241338.395520:0:3638:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890d47833800 x1868815140031232/t0(0) o103->MGC192.168.204.158@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782241354 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1782241338.395530:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1782241338.395533:0:3638:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1782241338.395534:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1782241338.395601:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:62797b42-772f-434f-be35-dfdfcff291e0:0:1868815140030976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241338.397937:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:0:1868815140031104:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241338.398253:0:8441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e192fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e19304 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.398264:0:8441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241338.398380:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e192fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e19304 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.398390:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e192fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9959f2fb1e19304 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241338.398411:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241338.398413:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241338.398416:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782241338.398436:0:15259:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1782241338.398440:0:15259:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1782241338.398446:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782241338.398451:0:15259:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1782241338.398456:0:15259:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff890e77a76000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782241338.398462:0:15259:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff890d45a64000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782241338.398467:0:15259:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff890e81740000) has exports, disconnecting them 00000020:00080000:1.0:1782241338.398471:0:15259:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff890e77a76000), last request at 1782241337 00000020:00000080:1.0:1782241338.398479:0:15259:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e195dc 00000100:00080000:1.0:1782241338.398496:0:15259:0:(import.c:65:import_set_state_nolock()) ffff890e77a70800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1782241338.398543:0:15259:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890e77a76000): rc 0 00000020:00000080:1.0:1782241338.398546:0:15259:0:(genops.c:906:class_export_put()) final put ffff890e77a76000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1782241338.398559:0:15259:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff890d45a64000), last request at 1782241337 00000020:00000080:1.0:1782241338.398564:0:15259:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e194b6 00000100:00080000:1.0:1782241338.398571:0:15259:0:(import.c:65:import_set_state_nolock()) ffff890d45a63800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1782241338.398584:0:15259:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890d45a64000): rc 0 00000020:00000080:1.0:1782241338.398586:0:15259:0:(genops.c:906:class_export_put()) final put ffff890d45a64000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1782241338.398595:0:15259:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa60ac1473ae0 00000100:00080000:1.0:1782241338.398614:0:15259:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782241338.398621:0:15259:0:(client.c:3600:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff890d45a49180 x1868815140027648/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1782241347 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241338.398637:0:15259:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:3.0:1782241338.402866:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241338.402909:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:62797b42-772f-434f-be35-dfdfcff291e0:0:1868815140031488:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1782241338.402946:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff890e77a76000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1782241338.402993:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff890d45a64000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1782241338.403014:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e77a70800 for lustre-MDT0001 00000020:00000080:3.0:1782241338.403018:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d45a63800 for lustre-MDT0001 00000100:00100000:3.0:1782241338.403043:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140027648:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782241338.403506:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241338.403534:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782241338.403661:0:15259:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782241338.403667:0:15259:0:(import.c:65:import_set_state_nolock()) ffff890e43f76000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1782241338.404242:0:15259:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782241338.404247:0:15259:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1782241338.404299:0:15259:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1782241338.404364:0:15259:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1782241338.404389:0:15259:0:(import.c:65:import_set_state_nolock()) ffff890d45a79800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1782241338.404412:0:15259:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1782241338.404415:0:15259:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:1.0:1782241338.404423:0:15259:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1782241338.404472:0:15259:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1782241338.404482:0:15259:0:(import.c:65:import_set_state_nolock()) ffff890d46bb2000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1782241338.404508:0:15259:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff890e81740000) has no exports 00000100:00080000:2.0:1782241338.405000:0:3638:0:(import.c:65:import_set_state_nolock()) ffff890e47173000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782241338.405008:0:3638:0:(import.c:512:import_select_connection()) MGC192.168.204.158@tcp: connect to NID 0@lo last attempt 146 00000100:00080000:2.0:1782241338.405017:0:3638:0:(import.c:626:import_select_connection()) MGC192.168.204.158@tcp: import ffff890e47173000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241338.405184:0:3638:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e47aead80 x1868815140031872/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782241338.405216:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140031360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241338.405226:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140029696:0@lo:400:kworker.0 00000100:00100000:2.0:1782241338.405251:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:62797b42-772f-434f-be35-dfdfcff291e0:3638:1868815140031232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241338.405363:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140031616:0@lo:9:umount.0 00000100:00100000:0.0:1782241338.405431:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241338.405504:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140031744:0@lo:9:umount.0 00000100:00100000:0.0:1782241338.405525:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241338.405556:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:62797b42-772f-434f-be35-dfdfcff291e0:3636:1868815140031872:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1782241338.405572:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868815140031872 offset 0 length 520: 4 00000100:00100000:1.0:1782241338.405785:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140031616 00000100:00100000:1.0:1782241338.405794:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140031616 00000100:00100000:1.0:1782241338.405836:0:8747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140031744 00000100:00100000:1.0:1782241338.405839:0:8747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140031744 00000100:00100000:1.0:1782241338.405863:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782241338.405873:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3636:x1868815140031616:12345-0@lo:9:umount.0 00000020:00000080:1.0:1782241338.405912:0:8747:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19503 00000100:00100000:2.0:1782241338.406000:0:8746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782241338.406009:0:8746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1868815140031744:12345-0@lo:9:umount.0 00000100:00080000:1.0:1782241338.406271:0:8747:0:(import.c:65:import_set_state_nolock()) ffff890d45a66800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782241338.406329:0:8747:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1782241338.406476:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3636:x1868815140031616:12345-0@lo:9:umount.0 Request processed in 603us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241338.406484:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1782241338.406531:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d45a79800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1782241338.406734:0:8746:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19645 00000100:00080000:2.0:1782241338.406808:0:8746:0:(import.c:65:import_set_state_nolock()) ffff890d46922800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782241338.406844:0:8746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1782241338.406955:0:8746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3636:x1868815140031744:12345-0@lo:9:umount.0 Request processed in 946us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241338.406962:0:8746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:2.0:1782241338.407124:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241338.407475:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782241338.407667:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1782241338.407989:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782241338.407996:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140031616:0@lo:9:umount.0 00000100:00080000:1.0:1782241338.408026:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d46bb2000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1782241338.408050:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1782241338.408052:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782241338.408055:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140031744:0@lo:9:umount.0 00000020:00080000:2.0:1782241338.419036:0:15259:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff890e81740000) has no exports 00000020:01000000:3.0:1782241338.503350:0:15259:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890d47681480 - data ffff890e78eca5e8/ffff890d47915000 00000020:01000000:3.0:1782241338.503509:0:15259:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890e42fab900 - data ffff890e78dc1798/ffff890e7d525400 00000001:00000004:3.0:1782241338.529252:0:15259:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1782241338.578422:0:15259:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782241338.578435:0:15259:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1782241338.578448:0:15259:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1782241338.583212:0:15259:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782241338.583225:0:15259:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:1.0:1782241338.583251:0:15259:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782241338.583255:0:15259:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1782241338.583737:0:8738:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1782241338.583744:0:8738:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1782241338.583811:0:8738:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1782241338.584491:0:15259:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1782241338.584497:0:15259:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:3.0:1782241338.584515:0:15259:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782241338.584518:0:15259:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1782241338.585148:0:9974:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1782241338.585153:0:9974:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1782241338.585194:0:9974:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1782241338.586623:0:15259:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19320 00000020:00000080:3.0:1782241338.586636:0:15259:0:(genops.c:906:class_export_put()) final put ffff890e81726000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1782241338.586843:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e81726000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1782241338.590668:0:15259:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19335 00000020:00000080:3.0:1782241338.590684:0:15259:0:(genops.c:906:class_export_put()) final put ffff890e8174a800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1782241338.590703:0:15259:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1782241338.590708:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241338.590716:0:15259:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782241338.590721:0:15259:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff890e43fe99c0) has no exports 00000004:01000000:3.0:1782241338.590920:0:15259:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1782241338.590928:0:15259:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1963e 00000020:00000080:3.0:1782241338.590933:0:15259:0:(genops.c:906:class_export_put()) final put ffff890d47591000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1782241338.590938:0:15259:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1782241338.590942:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241338.590949:0:15259:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782241338.590951:0:15259:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff890d46743380) has no exports 00000020:00000080:3.0:1782241338.590958:0:15259:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19637 00000020:00000080:3.0:1782241338.590962:0:15259:0:(genops.c:906:class_export_put()) final put ffff890d46bb4000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1782241338.591240:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e8174a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1782241338.591251:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47591000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1782241338.591257:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d46bb4000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1782241338.593996:0:15259:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1782241338.594005:0:15259:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1782241338.594009:0:15259:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:3.0:1782241338.594019:0:15259:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782241338.594022:0:15259:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782241338.594227:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241338.594242:0:15259:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1782241338.594251:0:15259:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e194fc 00000020:00000080:3.0:1782241338.594278:0:15259:0:(genops.c:906:class_export_put()) final put ffff890d46663800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1782241338.594284:0:15259:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1782241338.594290:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241338.594296:0:15259:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782241338.594299:0:15259:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff890d46740000) has no exports 00000020:00000080:3.0:1782241338.594306:0:15259:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e194f5 00000020:00000080:3.0:1782241338.594310:0:15259:0:(genops.c:906:class_export_put()) final put ffff890d45a7f000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1782241338.595062:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d46bb2000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1782241338.595074:0:36:0:(genops.c:906:class_export_put()) final put ffff890d46bb5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1782241338.595077:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d46bb5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1782241338.595084:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1782241338.595181:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d46663800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1782241338.595188:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d45a7f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1782241338.595368:0:15259:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1782241338.595829:0:15259:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1782241338.595833:0:15259:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1782241338.595840:0:15259:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782241338.595842:0:15259:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782241338.595904:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241338.595915:0:15259:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1782241338.595933:0:15259:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1782241338.595940:0:15259:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19358 00000020:00000080:3.0:1782241338.595949:0:15259:0:(genops.c:906:class_export_put()) final put ffff890e7d52e800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1782241338.595955:0:15259:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1782241338.595959:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241338.595963:0:15259:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782241338.595966:0:15259:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff890e81fccd40) has no exports 00000020:00000080:3.0:1782241338.595971:0:15259:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19351 00000020:00000080:3.0:1782241338.595975:0:15259:0:(genops.c:906:class_export_put()) final put ffff890e43f75800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1782241338.596242:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d45a79800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1782241338.596250:0:36:0:(genops.c:906:class_export_put()) final put ffff890d46666800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1782241338.596252:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d46666800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1782241338.596258:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1782241338.596312:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d52e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1782241338.596329:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e43f75800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1782241338.630386:0:15259:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1782241338.630403:0:15259:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782241338.630409:0:15259:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1782241338.630417:0:15259:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782241338.630475:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241338.630487:0:15259:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1782241338.630515:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241338.630518:0:15259:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1782241338.630524:0:15259:0:(genops.c:906:class_export_put()) final put ffff890e81721000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1782241338.630529:0:15259:0:(genops.c:865:class_export_destroy()) destroying export ffff890e81721000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1782241338.630542:0:15259:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1782241338.630715:0:15259:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1933c 00000020:00000080:2.0:1782241338.630721:0:15259:0:(genops.c:906:class_export_put()) final put ffff890e8174d000/lustre-MDD0001_UUID 00000020:01000000:2.0:1782241338.630726:0:15259:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1782241338.630730:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782241338.630735:0:15259:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782241338.630739:0:15259:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff890e81743380) has no exports 00000020:00000080:2.0:1782241338.630784:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241338.630789:0:15259:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1782241338.630794:0:15259:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19343 00000020:00000080:2.0:1782241338.630799:0:15259:0:(genops.c:906:class_export_put()) final put ffff890e8174e000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1782241338.630808:0:15259:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e43609000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1782241338.630811:0:15259:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e43609000 2 00000020:01000004:2.0:1782241338.630826:0:15259:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff890e43609000 from lustre-MDT0001 00000020:00000080:2.0:1782241338.630850:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241338.630855:0:15259:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1782241338.630858:0:15259:0:(genops.c:906:class_export_put()) final put ffff890e81725800/lustre-MDT0001_UUID 00000020:00000080:2.0:1782241338.630860:0:15259:0:(genops.c:865:class_export_destroy()) destroying export ffff890e81725800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1782241338.630868:0:15259:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1782241338.630915:0:15259:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1782241338.630918:0:15259:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1782241338.630921:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782241338.630924:0:15259:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782241338.630931:0:15259:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff890e7d549000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782241338.630936:0:15259:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff890e7c694d40) has exports, disconnecting them 00000020:00080000:2.0:1782241338.630940:0:15259:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff890e7d549000), last request at 1782241100 00000020:00000080:2.0:1782241338.630944:0:15259:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19397 00000020:00080000:2.0:1782241338.630957:0:15259:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890e7d549000): rc 0 00000020:00000080:2.0:1782241338.630960:0:15259:0:(genops.c:906:class_export_put()) final put ffff890e7d549000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1782241338.632138:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e43f76000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1782241338.632240:0:36:0:(genops.c:906:class_export_put()) final put ffff890e81725000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1782241338.632242:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e81725000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1782241338.632254:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1782241338.632363:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e8174d000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1782241338.632367:0:36:0:(genops.c:906:class_export_put()) final put ffff890e81722800/lustre-MDD0001_UUID 00000020:00000080:1.0:1782241338.632369:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e81722800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1782241338.632372:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1782241338.632637:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e8174e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1782241338.632642:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d549000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1782241338.642481:0:15259:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1782241338.642491:0:15259:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782241338.642495:0:15259:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782241338.642504:0:15259:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782241338.642599:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e7d54f800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1782241338.642693:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241338.642702:0:15259:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1782241338.642708:0:15259:0:(genops.c:906:class_export_put()) final put ffff890e7d54c800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1782241338.642716:0:15259:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d54c800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1782241338.642729:0:15259:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1782241338.642834:0:15259:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e43609000 1 00000020:00000080:3.0:1782241338.642841:0:15259:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e192d3 00000020:00000080:3.0:1782241338.642848:0:15259:0:(genops.c:906:class_export_put()) final put ffff890e4360b800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1782241338.642854:0:15259:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1782241338.642858:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241338.642863:0:15259:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782241338.642867:0:15259:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff890e7c6919c0) has no exports 00000020:00000080:1.0:1782241338.642875:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e4360b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1782241338.699647:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782241338.699660:0:15259:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1782241338.699666:0:15259:0:(genops.c:906:class_export_put()) final put ffff890e4360c000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1782241338.699671:0:15259:0:(genops.c:865:class_export_destroy()) destroying export ffff890e4360c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1782241338.699684:0:15259:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1782241338.699840:0:15259:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff890e43608000 00000020:01000000:1.0:1782241338.699861:0:15259:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1782241338.699865:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782241338.699870:0:15259:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782241338.699874:0:15259:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff890e503f3380) has no exports 00000100:00100000:1.0:1782241338.699980:0:6512:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff890e463efa00:6512] 2 exiting: rc = 0 00000100:00100000:3.0:1782241338.700048:0:6510:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff890e48160400:6510] 0 exiting: rc = 1 00000100:00100000:3.0:1782241338.700136:0:10147:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff890e7c6cb800:10147] 3 exiting: rc = 0 00000100:00100000:3.0:1782241338.700201:0:11191:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff890d4790d400:11191] 4 exiting: rc = 0 00000100:00100000:0.0:1782241338.702975:0:6511:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff890e4bb5ee00:6511] 1 exiting: rc = 0 00000100:00100000:1.0:1782241338.703623:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703643:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703648:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703653:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703659:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703675:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703680:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703686:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703691:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703696:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703702:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703707:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703713:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703718:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703724:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703729:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703736:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703743:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703748:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703753:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703777:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703785:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703792:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703797:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.703806:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.704459:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.704468:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.704473:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.704479:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.704484:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.704489:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709562:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709584:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709591:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709598:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709604:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709610:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709615:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709620:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709627:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709645:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709652:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709657:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709663:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709668:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709674:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709680:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709686:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709692:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709696:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709702:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709707:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709712:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709717:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709722:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709728:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709734:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709739:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709744:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709750:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709793:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709799:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709805:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.709811:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.721386:0:6513:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff890e42f65200:6513] 0 exiting: rc = 1 00000100:00100000:2.0:1782241338.721389:0:6514:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff890e463ef400:6514] 1 exiting: rc = 0 00000100:00100000:2.0:1782241338.721949:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.721958:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.721966:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.721972:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.721978:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.721983:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.721989:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.721996:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722001:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722007:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722013:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722038:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722045:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722050:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722056:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722080:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722084:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722090:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722095:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722099:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722104:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722109:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722114:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722119:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722123:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722127:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722263:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722274:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722279:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722283:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722288:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722292:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722297:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722301:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722306:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722311:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722315:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722320:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722325:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722329:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722334:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722338:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722343:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722348:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722353:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722358:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722362:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722367:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722372:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722377:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722389:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722394:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722399:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722403:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722408:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722412:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722416:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722421:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722427:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722432:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722439:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722445:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722450:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722456:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.722921:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff890e43662600:6516] 1 exiting: rc = 0 00000100:00100000:0.0:1782241338.723070:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff890e43662000:6515] 0 exiting: rc = 1 00000100:00100000:3.0:1782241338.723502:0:7836:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff890e7d536e00:7836] 2 exiting: rc = 0 00000100:00100000:2.0:1782241338.729482:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729495:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729504:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729537:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729543:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729548:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729555:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729560:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729566:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729571:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729577:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729584:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729590:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729596:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729602:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729621:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729629:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729635:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729641:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729647:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729669:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729675:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729681:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729687:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729693:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729699:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729705:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729726:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729733:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729738:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729745:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729751:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729773:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729780:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729788:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729794:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729800:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729805:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729810:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729829:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729837:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729842:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729848:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729853:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729860:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729866:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729872:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729909:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729917:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729924:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729931:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729954:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729962:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729967:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729974:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729989:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.729995:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.730002:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.730010:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.730017:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.730058:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.730065:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.730071:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.730084:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.758691:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff890e4cf3a400:6517] 0 exiting: rc = 1 00000100:00100000:2.0:1782241338.770716:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff890e4cf3ba00:6518] 1 exiting: rc = 0 00000100:00100000:3.0:1782241338.771000:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771008:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771013:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771019:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771041:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771047:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771052:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771057:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771062:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771067:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771071:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771076:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771081:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771086:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771090:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771096:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771101:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771105:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771111:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771116:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771120:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771125:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771130:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771149:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771154:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771159:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771164:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771168:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771172:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771176:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771181:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771185:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771190:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771194:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771199:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771203:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771208:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771212:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771218:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771222:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771226:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771231:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771235:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771241:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771246:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771252:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771257:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771261:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771266:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771271:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771276:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771281:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771285:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771292:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771296:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771301:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771306:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771311:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771324:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771329:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771334:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771338:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771343:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.771347:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782241338.771946:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff890e4cf3ac00:6519] 0 exiting: rc = 1 00000100:00100000:2.0:1782241338.772443:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff890e45d82200:6520] 1 exiting: rc = 0 00000100:00100000:3.0:1782241338.774568:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774577:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774582:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774587:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774591:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774595:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774600:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774605:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774610:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774614:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774618:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774622:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774627:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774631:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774636:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774640:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774645:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774649:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774654:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774659:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774664:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774668:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774672:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774677:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774682:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774686:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774691:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774695:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774700:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774719:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774725:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774729:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774733:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774738:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774742:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774747:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774751:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774786:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774792:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774797:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774802:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774806:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774811:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774816:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774820:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774825:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774829:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774834:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774839:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774844:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774849:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774853:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774857:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774862:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774866:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774871:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774890:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774900:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774907:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774914:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774921:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774928:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774935:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.774939:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.775472:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff890e436cd200:6522] 1 exiting: rc = 0 00000100:00100000:1.0:1782241338.775715:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff890e436cd600:6521] 0 exiting: rc = 1 00000100:00100000:3.0:1782241338.775949:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.775955:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.775959:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.775964:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.775968:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.775973:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.775978:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.775983:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.775989:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.775993:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.775998:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776002:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776007:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776012:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776016:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776034:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776040:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776045:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776049:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776054:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776058:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776062:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776067:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776072:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776077:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776083:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776088:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776093:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776098:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776103:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776107:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776112:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776117:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776123:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776128:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776143:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776149:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776153:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776158:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776163:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776168:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776173:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776178:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776182:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776187:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776191:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776196:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776201:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776205:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776210:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776215:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776219:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776224:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776228:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776233:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776237:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776242:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776247:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776251:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776256:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776261:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776266:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776272:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241338.776277:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.777866:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff890e436cd000:6523] 0 exiting: rc = 1 00000100:00100000:1.0:1782241338.782042:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff890e436cca00:6524] 1 exiting: rc = 0 00000100:00100000:3.0:1782241338.782477:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff890e43f16400:6525] 2 exiting: rc = 0 00000100:00100000:2.0:1782241338.782575:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782583:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782589:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782595:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782600:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782605:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782619:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782625:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782630:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782636:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782642:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782647:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782652:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782658:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782664:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782675:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782681:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782687:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782693:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782698:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782703:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782721:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782727:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782733:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782738:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782743:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782748:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782777:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782784:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782789:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782795:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782800:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782806:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782811:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782817:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782822:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782827:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782833:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782838:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782856:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782862:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782867:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782873:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782888:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782894:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782900:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782905:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782911:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782916:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782922:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782927:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782932:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782937:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782942:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782947:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782952:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782963:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782968:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782973:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782979:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782984:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782990:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.782995:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241338.783010:0:15259:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1782241338.793748:0:15259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241338.794215:0:15259:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1782241338.794221:0:15259:0:(genops.c:906:class_export_put()) final put ffff890e4599e800/MDS_uuid 00000020:00000080:2.0:1782241338.794226:0:15259:0:(genops.c:865:class_export_destroy()) destroying export ffff890e4599e800/MDS_uuid for MDS 00000020:01000000:2.0:1782241338.794232:0:15259:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1782241338.794480:0:15259:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1782241339.014286:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241340.037146:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241341.061039:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241342.087177:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782241342.731123:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 62797b42-772f-434f-be35-dfdfcff291e0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782241342.731134:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 62797b42-772f-434f-be35-dfdfcff291e0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782241342.731138:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782241342.731150:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782241342.731155:0:8:0:(import.c:65:import_set_state_nolock()) ffff890d45a7f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782241342.731166:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 400 00000100:00080000:1.0:1782241342.731174:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1782241342.731184:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff890d45a7f800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241342.731248:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a49f80 x1868815140032000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241342.731304:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782241342.731307:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782241342.731309:0:8:0:(import.c:65:import_set_state_nolock()) ffff890d47595800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782241342.731313:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 400 00000100:00080000:1.0:1782241342.731316:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1782241342.731320:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff890d47595800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241342.731332:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a48000 x1868815140032256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782241342.731394:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1868815140032000:0@lo:38:kworker.0 00000400:00000100:1.0:1782241342.731468:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140032000 offset 0 length 520: 4 00000100:00100000:1.0:1782241342.731521:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815140032256:0@lo:38:kworker.0 00000400:00000100:1.0:1782241342.731539:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140032256 offset 0 length 520: 4 00000100:00100000:3.0:1782241342.732064:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140032128:0@lo:400:kworker.0 00000400:00000100:3.0:1782241342.732107:0:3640:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140032128 offset 0 length 224: 4 00000100:00100000:3.0:1782241342.732152:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140032384:0@lo:400:kworker.0 00000400:00000100:3.0:1782241342.732170:0:3637:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140032384 offset 0 length 224: 4 00000020:01000004:3.0:1782241343.073509:0:15460:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1782241343.098703:0:15460:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1782241343.104926:0:15460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19717 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241343.104949:0:15460:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19717 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241343.104956:0:15460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e19717 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241343.104963:0:15460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e19717 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241343.106606:0:15460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782241343.106619:0:15460:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1782241343.106653:0:15460:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782241343.106666:0:15460:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890d45a49f80 x1868815140032000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782241362 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241343.106725:0:15460:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1782241343.106733:0:15460:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1782241343.106739:0:15460:0:(import.c:65:import_set_state_nolock()) ffff890d45a7f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1782241343.106744:0:15460:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782241343.106748:0:15460:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890d45a49f80 x1868815140032000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782241362 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1782241343.106819:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241343.106827:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e19717 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241343.106835:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e47180400 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:0.0:1782241343.106838:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e19717 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241343.106847:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e19717 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241343.106864:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e19717 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241343.106885:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782241343.106888:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782241343.106890:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782241343.106904:0:6499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff890e47173000 00010000:00010000:0.0:1782241343.106908:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e19717 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241343.106914:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e47180400/0xc9959f2fb1e19710 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e19717 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241343.106924:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241343.106926:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241343.106928:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241343.107306:0:15460:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1782241343.107335:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1868815140032000:0@lo:38:kworker.0 00000100:00100000:3.0:1782241343.107392:0:15460:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1782241343.108479:0:15460:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1782241343.108491:0:15460:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890d45a48380 x1868815140032128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241358 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1782241343.110378:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241343.110545:0:15460:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1782241343.110553:0:15460:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1782241343.110593:0:15460:0:(import.c:65:import_set_state_nolock()) ffff890d46661800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1782241343.110661:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1868815140032512:0@lo:39:umount.0 00000400:00000100:2.0:1782241343.110716:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140032512 offset 0 length 224: 4 00000100:00100000:0.0:1782241343.111199:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140032128:0@lo:400:kworker.0 00000100:00080000:1.0:1782241343.748880:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 62797b42-772f-434f-be35-dfdfcff291e0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782241343.748893:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 62797b42-772f-434f-be35-dfdfcff291e0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782241343.748897:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782241343.748921:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782241343.749280:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815140032640:0@lo:400:kworker.0 00000400:00000100:3.0:1782241343.749340:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140032640 offset 0 length 224: 4 00000001:00100000:3.0:1782241343.755099:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1782241343.755122:0:9506:0:(genops.c:906:class_export_put()) final put ffff890d45a40000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1782241343.755204:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d45a40000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1782241343.755290:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d46922800 for lustre-OST0001 00000001:00100000:3.0:1782241343.755472:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1782241343.755476:0:8419:0:(genops.c:906:class_export_put()) final put ffff890d45a60800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1782241343.755592:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff890d45a60800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1782241343.755626:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d45a66800 for lustre-OST0000 00010000:00010000:3.0:1782241344.133736:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241345.157008:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241346.181063:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782241346.756995:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 62797b42-772f-434f-be35-dfdfcff291e0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782241346.757007:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 62797b42-772f-434f-be35-dfdfcff291e0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241346.757010:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782241346.757013:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782241346.757625:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782241346.757647:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140032768:0@lo:400:kworker.0 00000400:00000100:0.0:1782241346.757704:0:3640:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140032768 offset 0 length 224: 4 00010000:00010000:1.0:1782241347.208363:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241348.229068:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241348.229174:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241338/real 1782241338] req@ffff890e47aead80 x1868815140031872/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782241348 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241348.229205:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e47aead80 x1868815140031872/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782241348 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782241348.229227:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e47173000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782241348.229251:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1782241348.229255:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:62797b42-772f-434f-be35-dfdfcff291e0:3636:1868815140031872:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1782241348.229433:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 62797b42-772f-434f-be35-dfdfcff291e0->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782241348.229438:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1782241348.229441:0:36:0:(import.c:65:import_set_state_nolock()) ffff890e47173000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782241348.229447:0:36:0:(import.c:512:import_select_connection()) MGC192.168.204.158@tcp: connect to NID 0@lo last attempt 401 00000100:00080000:1.0:1782241348.229700:0:36:0:(import.c:591:import_select_connection()) MGC192.168.204.158@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1782241348.229709:0:36:0:(import.c:626:import_select_connection()) MGC192.168.204.158@tcp: import ffff890e47173000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241348.229746:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a49500 x1868815140032896/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241348.229795:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782241348.229800:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782241348.229942:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140033024:0@lo:400:kworker.0 00000400:00000100:0.0:1782241348.229996:0:3640:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140033024 offset 0 length 224: 4 00000100:00100000:2.0:1782241348.230278:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:62797b42-772f-434f-be35-dfdfcff291e0:3636:1868815140032896:0@lo:250:kworker.0 00000400:00000100:2.0:1782241348.230304:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868815140032896 offset 0 length 520: 4 00010000:00010000:0.0:1782241349.254789:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241350.277079:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241351.301464:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241352.325275:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241353.348926:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241343/real 1782241343] req@ffff890d48135880 x1868815140032512/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782241353 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241353.348959:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890d48135880 x1868815140032512/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782241353 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782241353.348983:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d46661800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1782241353.349006:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1868815140032512:0@lo:39:umount.0 00000100:00080000:3.0:1782241353.349067:0:15460:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1782241353.349071:0:15460:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1782241353.349078:0:15460:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1782241353.349341:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241353.350257:0:15460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19725 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241353.350276:0:15460:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19725 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241353.350285:0:15460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e19725 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241353.350291:0:15460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e19725 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241353.350390:0:15460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241353.350399:0:15460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1999b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241353.350407:0:15460:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1999b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241353.350414:0:15460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1999b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241353.350439:0:15460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1999b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241353.352474:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782241353.352490:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e19725 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241353.352519:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c3800 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:0.0:1782241353.352523:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e19725 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241353.352531:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e19725 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241353.352536:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e19725 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241353.352539:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782241353.352541:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1782241353.352554:0:6499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff890e47173000 00010000:00010000:0.0:1782241353.352557:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e19725 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241353.352561:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e821c3800/0xc9959f2fb1e1971e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e19725 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241353.352612:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241353.352616:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1999b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241353.352623:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad800 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:0.0:1782241353.352626:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1999b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241353.352633:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1999b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241353.352645:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1999b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241353.352651:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782241353.352653:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1782241353.352659:0:6499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff890e47173000 00010000:00010000:0.0:1782241353.352662:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1999b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241353.352668:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241353.352670:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241353.352673:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241353.353543:0:15460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782241353.353554:0:15460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e43fad800/0xc9959f2fb1e19994 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1999b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241353.353567:0:15460:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1782241353.353574:0:15460:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1782241353.353577:0:15460:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1782241353.353622:0:15460:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1782241353.353628:0:15460:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:1.0:1782241353.353633:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782241353.353637:0:15460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241353.353648:0:15460:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782241353.353653:0:15460:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff890e503f19c0) has no exports 00000020:00080000:3.0:1782241353.353680:0:15460:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff890e503f19c0) has no exports 00000020:01000000:3.0:1782241353.359131:0:15460:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890d477ac600 - data ffff890e78f0eca8/ffff890e7795d800 00000020:01000000:3.0:1782241353.359622:0:15460:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890d418dff00 - data ffff890e78e88870/ffff890d46509800 00100000:10000000:2.0:1782241353.369177:0:15460:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1782241353.380148:0:15460:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19470 00000020:00000080:0.0:1782241353.380162:0:15460:0:(genops.c:906:class_export_put()) final put ffff890d45a7c000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1782241353.380186:0:15460:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e7d6df800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1782241353.380190:0:15460:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e7d6df800 2 00000020:01000004:0.0:1782241353.380193:0:15460:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff890e7d6df800 from lustre-OST0000 00000020:00000080:1.0:1782241353.380265:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff890d45a7c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1782241353.380342:0:15460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782241353.380354:0:15460:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1782241353.380358:0:15460:0:(genops.c:906:class_export_put()) final put ffff890e477e6800/lustre-OST0000_UUID 00000020:00000080:0.0:1782241353.380360:0:15460:0:(genops.c:865:class_export_destroy()) destroying export ffff890e477e6800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1782241353.380630:0:15460:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1782241353.380692:0:15460:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1782241353.380697:0:15460:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1782241353.380700:0:15460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782241353.384974:0:15460:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1782241353.384990:0:15460:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff890e47799000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782241353.384998:0:15460:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff890e503f4d40) has exports, disconnecting them 00000020:00080000:0.0:1782241353.385004:0:15460:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff890e47799000), last request at 1782241119 00000020:00000080:0.0:1782241353.385027:0:15460:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e1949a 00000020:00080000:0.0:1782241353.385045:0:15460:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890e47799000): rc 0 00000020:00000080:0.0:1782241353.385051:0:15460:0:(genops.c:906:class_export_put()) final put ffff890e47799000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1782241353.385097:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff890e47799000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1782241353.386141:0:15460:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1782241353.386148:0:15460:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782241353.386152:0:15460:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782241353.386158:0:15460:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782241353.386269:0:15460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782241353.386279:0:15460:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1782241353.386286:0:15460:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1782241353.386290:0:15460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782241353.386294:0:15460:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1782241353.386299:0:15460:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff890d46662800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782241353.386305:0:15460:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff890e503f0000) has exports, disconnecting them 00000020:00080000:0.0:1782241353.386309:0:15460:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff890d46662800), last request at 1782241119 00000020:00000080:0.0:1782241353.386313:0:15460:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e194af 00000020:00000080:3.0:1782241353.386315:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d45a7f800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1782241353.386323:0:8:0:(genops.c:906:class_export_put()) final put ffff890d45a78800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1782241353.386326:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff890d45a78800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:00080000:0.0:1782241353.386327:0:15460:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890d46662800): rc 0 00000020:01000000:3.0:1782241353.386334:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1782241353.386335:0:15460:0:(genops.c:906:class_export_put()) final put ffff890d46662800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1782241353.386391:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff890d46662800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1782241353.397814:0:15460:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1782241353.397823:0:15460:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1782241353.397827:0:15460:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782241353.397835:0:15460:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782241353.397884:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d46661800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1782241353.398054:0:15460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241353.398069:0:15460:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1782241353.398074:0:15460:0:(genops.c:906:class_export_put()) final put ffff890d45a7e800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1782241353.398078:0:15460:0:(genops.c:865:class_export_destroy()) destroying export ffff890d45a7e800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1782241353.398088:0:15460:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1782241353.398152:0:15460:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e7d6df800 1 00000020:00000080:3.0:1782241353.398157:0:15460:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19438 00000020:00000080:3.0:1782241353.398167:0:15460:0:(genops.c:906:class_export_put()) final put ffff890e7d75f800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1782241353.398186:0:15460:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1782241353.398194:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d75f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1782241353.398204:0:15460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241353.398209:0:15460:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782241353.398213:0:15460:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff890e7c690000) has no exports 00000020:00000080:3.0:1782241353.446093:0:15460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241353.446109:0:15460:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1782241353.446115:0:15460:0:(genops.c:906:class_export_put()) final put ffff890e7d6da000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1782241353.446121:0:15460:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d6da000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1782241353.446134:0:15460:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1782241353.446254:0:15460:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff890e7d6d9800 00000020:02000400:3.0:1782241353.446382:0:15460:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:2.0:1782241353.489800:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 62797b42-772f-434f-be35-dfdfcff291e0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782241353.489810:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 62797b42-772f-434f-be35-dfdfcff291e0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241353.489823:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782241353.489826:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782241353.489949:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782241353.489971:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815140033152:0@lo:400:kworker.0 00000400:00000100:1.0:1782241353.490032:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140033152 offset 0 length 224: 4 00010000:00010000:2.0:1782241354.373912:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241355.397170:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241356.424308:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782241357.009865:0:15661:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1782241357.026731:0:15661:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1782241357.026836:0:15661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e196fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241357.026850:0:15661:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e196fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241357.026858:0:15661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e196fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241357.026885:0:15661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e196fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241357.026909:0:15661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782241357.026914:0:15661:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1782241357.026939:0:15661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1782241357.027082:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241357.027090:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e196fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241357.027097:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860200 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241357.027100:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e196fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241357.027115:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e196fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241357.027122:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e196fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241357.027128:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782241357.027130:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1782241357.027133:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1782241357.027145:0:6498:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff890e47173000 00010000:00010000:1.0:1782241357.027149:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e196fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241357.027156:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e196f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e196fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241357.027167:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241357.027169:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241357.027171:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241357.027206:0:15661:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890d45a48000 x1868815140032256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782241362 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241357.027225:0:15661:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1782241357.027233:0:15661:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1782241357.027238:0:15661:0:(import.c:65:import_set_state_nolock()) ffff890d47595800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1782241357.027243:0:15661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782241357.027247:0:15661:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890d45a48000 x1868815140032256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782241362 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241357.027254:0:15661:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1782241357.027257:0:15661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:1.0:1782241357.027316:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815140032256:0@lo:38:kworker.0 00000100:00080000:2.0:1782241357.033339:0:15661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1782241357.033358:0:15661:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890d45a4a300 x1868815140032384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241358 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241357.033586:0:15661:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890d45a4a680 x1868815140032640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241359 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241357.033605:0:15661:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890e47aeb480 x1868815140032768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241362 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241357.033621:0:15661:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890d45a48a80 x1868815140033024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241364 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241357.033630:0:15661:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890e47aead80 x1868815140033152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241357.033637:0:15661:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1782241357.033644:0:15661:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1782241357.033669:0:15661:0:(import.c:65:import_set_state_nolock()) ffff890d46661000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1782241357.033741:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815140033152:0@lo:400:kworker.0 00000100:00100000:1.0:1782241357.033752:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815140032640:0@lo:400:kworker.0 00000100:00100000:1.0:1782241357.033818:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1868815140033280:0@lo:39:umount.0 00000400:00000100:1.0:1782241357.033863:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868815140033280 offset 0 length 224: 4 00000100:00100000:0.0:1782241357.034127:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140033024:0@lo:400:kworker.0 00000100:00100000:0.0:1782241357.034136:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1868815140032768:0@lo:400:kworker.0 00000100:00100000:3.0:1782241357.034296:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140032384:0@lo:400:kworker.0 00010000:00010000:2.0:1782241357.445248:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241358.474992:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782241358.598505:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 62797b42-772f-434f-be35-dfdfcff291e0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782241358.598513:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 62797b42-772f-434f-be35-dfdfcff291e0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1782241359.493016:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241360.516906:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241361.542242:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241362.565385:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241363.204957:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241348/real 1782241348] req@ffff890d45a49500 x1868815140032896/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782241363 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241363.204995:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890d45a49500 x1868815140032896/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782241363 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782241363.205022:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e47173000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241363.205050:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1782241363.205054:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:62797b42-772f-434f-be35-dfdfcff291e0:3636:1868815140032896:0@lo:250:kworker.0 00000100:00080000:2.0:1782241363.205259:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 62797b42-772f-434f-be35-dfdfcff291e0->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782241363.205265:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1782241363.205268:0:8:0:(import.c:65:import_set_state_nolock()) ffff890e47173000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782241363.205273:0:8:0:(import.c:512:import_select_connection()) MGC192.168.204.158@tcp: connect to NID 0@lo last attempt 411 00000100:00080000:2.0:1782241363.205278:0:8:0:(import.c:591:import_select_connection()) MGC192.168.204.158@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782241363.205305:0:8:0:(import.c:626:import_select_connection()) MGC192.168.204.158@tcp: import ffff890e47173000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241363.205336:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e47ae9880 x1868815140033408/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782241363.205426:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:62797b42-772f-434f-be35-dfdfcff291e0:3636:1868815140033408:0@lo:250:kworker.0 00000400:00000100:1.0:1782241363.205473:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868815140033408 offset 0 length 520: 4 00010000:00010000:0.0:1782241363.588969:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241364.613084:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241365.637411:0:8441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241366.661112:0:8440:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241367.301678:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241357/real 1782241357] req@ffff890e47aeb100 x1868815140033280/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782241367 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241367.301710:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e47aeb100 x1868815140033280/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782241367 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782241367.301733:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d46661000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1782241367.301777:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1868815140033280:0@lo:39:umount.0 00000100:00080000:1.0:1782241367.301925:0:15661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1782241367.301930:0:15661:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782241367.301935:0:15661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782241367.302973:0:15661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e19709 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241367.302988:0:15661:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e19709 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241367.303085:0:15661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e19709 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241367.303092:0:15661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e19709 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241367.303178:0:15661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241367.303205:0:15661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1998d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241367.303213:0:15661:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1998d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241367.303219:0:15661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1998d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241367.303225:0:15661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9959f2fb1e1998d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241367.303256:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782241367.303264:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e19709 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241367.303271:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c3200 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:0.0:1782241367.303281:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e19709 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241367.303290:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e19709 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241367.303298:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e19709 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241367.303304:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782241367.303307:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1782241367.303328:0:6499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff890e47173000 00010000:00010000:0.0:1782241367.303333:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e19709 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241367.303339:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e19702 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e19709 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241367.303357:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241367.303360:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1998d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241367.303366:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e47181e00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:0.0:1782241367.303368:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9959f2fb1e1998d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241367.303374:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1998d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241367.303381:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1998d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241367.303397:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782241367.303399:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1782241367.303405:0:6499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff890e47173000 00010000:00010000:0.0:1782241367.303407:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1998d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241367.303414:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241367.303416:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241367.303418:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241367.303506:0:15661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782241367.303512:0:15661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e47181e00/0xc9959f2fb1e19986 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1998d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241367.303525:0:15661:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1782241367.303529:0:15661:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1782241367.303533:0:15661:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1782241367.303565:0:15661:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1782241367.303570:0:15661:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1782241367.303575:0:15661:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782241367.303582:0:15661:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782241367.303587:0:15661:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff890d469199c0) has no exports 00000020:00080000:1.0:1782241367.303616:0:15661:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff890d469199c0) has no exports 00000020:01000000:1.0:1782241367.305268:0:15661:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890d468885a0 - data ffff890e78ddc000/ffff890d47933800 00000020:01000000:1.0:1782241367.305413:0:15661:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff890d47681720 - data ffff890e78cfb288/ffff890d475a8400 00010000:00010000:3.0:1782241367.305749:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1782241367.319904:0:15661:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1782241367.331347:0:15661:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19596 00000020:00000080:0.0:1782241367.331361:0:15661:0:(genops.c:906:class_export_put()) final put ffff890d45a7b000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1782241367.331383:0:15661:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e77a72800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1782241367.331388:0:15661:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e77a72800 2 00000020:01000004:0.0:1782241367.331392:0:15661:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff890e77a72800 from lustre-OST0001 00000020:00000080:0.0:1782241367.331419:0:15661:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782241367.331430:0:15661:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1782241367.331432:0:15661:0:(genops.c:906:class_export_put()) final put ffff890e7d75c800/lustre-OST0001_UUID 00000020:00000080:0.0:1782241367.331436:0:15661:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d75c800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1782241367.331443:0:15661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1782241367.331577:0:15661:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 62797b42-772f-434f-be35-dfdfcff291e0->MGS 00010000:00010000:0.0:1782241367.331603:0:15661:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e82057200/0xc9959f2fb1e192ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e192f6 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241367.331614:0:15661:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e82057200/0xc9959f2fb1e192ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e192f6 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241367.331621:0:15661:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1782241367.331623:0:15661:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1782241367.331626:0:15661:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1782241367.331641:0:15661:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff890e47173000 00010000:00010000:0.0:1782241367.331653:0:15661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e82057200/0xc9959f2fb1e192ef lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e192f6 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241367.331669:0:15661:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e821c2000/0xc9959f2fb1e19764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9959f2fb1e1976b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241367.331675:0:15661:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e821c2000/0xc9959f2fb1e19764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9959f2fb1e1976b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241367.331693:0:15661:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782241367.331695:0:15661:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1782241367.331697:0:15661:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1782241367.331712:0:15661:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff890e47173000 00010000:00010000:0.0:1782241367.331716:0:15661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e821c2000/0xc9959f2fb1e19764 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9959f2fb1e1976b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782241367.331733:0:15661:0:(import.c:65:import_set_state_nolock()) ffff890e47173000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1782241367.331736:0:15661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1782241367.331739:0:15661:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1782241367.331741:0:15661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1782241367.331744:0:15661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1782241367.331789:0:15661:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff890e47ae9880 x1868815140033408/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1782241383 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1782241367.331803:0:15661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1782241367.331806:0:15661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000020:00000080:3.0:1782241367.331870:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d45a7b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1782241367.331952:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:62797b42-772f-434f-be35-dfdfcff291e0:3636:1868815140033408:0@lo:250:kworker.0 10000000:01000000:0.0:1782241367.332532:0:15661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1782241367.332541:0:15661:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e191ec 00000020:00000080:0.0:1782241367.332548:0:15661:0:(genops.c:906:class_export_put()) final put ffff890e45998800/62797b42-772f-434f-be35-dfdfcff291e0 00000020:01000000:0.0:1782241367.332651:0:15661:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.204.158@tcp (flags='') 00000020:00000080:0.0:1782241367.332657:0:15661:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782241367.332663:0:15661:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.158@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1782241367.332667:0:15661:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff890e43633380) has no exports 10000000:01000000:2.0:1782241367.332735:0:6508:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1782241367.332849:0:15661:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.158@tcp: client import never connected 00000100:00080000:0.0:1782241367.332854:0:15661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1782241367.332856:0:15661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1782241367.332858:0:15661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1782241367.332860:0:15661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1782241367.332907:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e45998800/62797b42-772f-434f-be35-dfdfcff291e0 for MGC192.168.204.158@tcp 00000020:00000080:0.0:1782241367.333002:0:15661:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782241367.333008:0:15661:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.158@tcp (uuid 62797b42-772f-434f-be35-dfdfcff291e0) 00000020:01000000:0.0:1782241367.333013:0:15661:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1782241367.333016:0:15661:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782241367.333020:0:15661:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1782241367.333025:0:15661:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff890d46923000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782241367.333030:0:15661:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff890d4691cd40) has exports, disconnecting them 00000020:00080000:0.0:1782241367.333034:0:15661:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff890d46923000), last request at 1782241139 00000020:00000080:0.0:1782241367.333038:0:15661:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e195c0 00000020:00080000:0.0:1782241367.333061:0:15661:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890d46923000): rc 0 00000020:00000080:0.0:1782241367.333065:0:15661:0:(genops.c:906:class_export_put()) final put ffff890d46923000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1782241367.333195:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890e47173000 for MGC192.168.204.158@tcp 00000020:00000080:3.0:1782241367.333202:0:36:0:(genops.c:906:class_export_put()) final put ffff890e47170800/62797b42-772f-434f-be35-dfdfcff291e0 00000020:00000080:3.0:1782241367.333204:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890e47170800/62797b42-772f-434f-be35-dfdfcff291e0 for MGC192.168.204.158@tcp 00000020:01000000:3.0:1782241367.333209:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.158@tcp (62797b42-772f-434f-be35-dfdfcff291e0) 00000020:00000080:3.0:1782241367.334725:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d46923000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1782241367.353871:0:15661:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1782241367.353880:0:15661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782241367.353885:0:15661:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782241367.353893:0:15661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782241367.354094:0:15661:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782241367.354103:0:15661:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1782241367.354109:0:15661:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1782241367.354114:0:15661:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782241367.354118:0:15661:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782241367.354126:0:15661:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff890d46667800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782241367.354133:0:15661:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff890d47703380) has exports, disconnecting them 00000020:00080000:3.0:1782241367.354137:0:15661:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff890d46667800), last request at 1782241139 00000020:00000080:3.0:1782241367.354141:0:15661:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e195d5 00000020:00080000:3.0:1782241367.354157:0:15661:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff890d46667800): rc 0 00000020:00000080:3.0:1782241367.354162:0:15661:0:(genops.c:906:class_export_put()) final put ffff890d46667800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1782241367.354732:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d47595800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1782241367.354740:0:36:0:(genops.c:906:class_export_put()) final put ffff890d47597800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1782241367.354743:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d47597800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1782241367.354775:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1782241367.354844:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d46667800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1782241367.355855:0:15661:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1782241367.355862:0:15661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1782241367.355866:0:15661:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782241367.355872:0:15661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782241367.355895:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff890d46661000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1782241367.355936:0:8441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1782241367.356062:0:8440:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1782241367.357682:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1782241367.358016:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1782241367.358278:0:6494:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff890e7b801800:6494] 1 exiting: rc = 0 00000100:00100000:2.0:1782241367.358355:0:6493:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff890e7b800c00:6493] 0 exiting: rc = 1 00000100:00100000:2.0:1782241367.358413:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.358737:0:6495:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff890e7b800000:6495] 0 exiting: rc = 1 00000100:00100000:2.0:1782241367.358821:0:10330:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff890e7d7b3600:10330] 3 exiting: rc = 0 00000100:00100000:2.0:1782241367.358881:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff890e567a0a00:6497] 2 exiting: rc = 0 00000100:00100000:2.0:1782241367.358946:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff890e47f6da00:6496] 1 exiting: rc = 0 00000100:00100000:1.0:1782241367.359639:0:10331:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff890d475a3200:10331] 4 exiting: rc = 0 00000100:00100000:2.0:1782241367.359732:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359740:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359746:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359754:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359784:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359791:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359798:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359804:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359810:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359819:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359826:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359831:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359839:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359848:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359855:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359860:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359866:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359872:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359879:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359884:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359890:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359894:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359899:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359903:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359907:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359923:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359928:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359933:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359938:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359943:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359948:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359954:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359959:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359964:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359968:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359974:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359979:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359986:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359991:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.359997:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360002:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360007:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360013:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360019:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360025:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360030:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360036:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360055:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360060:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360066:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360076:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360081:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360087:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360092:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360101:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360107:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360112:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360117:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360123:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360128:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360141:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360146:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360151:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.360161:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1782241367.362683:0:15661:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241367.362693:0:15661:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1782241367.362699:0:15661:0:(genops.c:906:class_export_put()) final put ffff890d46664800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1782241367.362704:0:15661:0:(genops.c:865:class_export_destroy()) destroying export ffff890d46664800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1782241367.362708:0:15661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1782241367.362771:0:15661:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e77a72800 1 00000020:00000080:2.0:1782241367.362777:0:15661:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc9959f2fb1e19565 00000020:00000080:2.0:1782241367.362783:0:15661:0:(genops.c:906:class_export_put()) final put ffff890d46921800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1782241367.362795:0:15661:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1782241367.362805:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff890d46921800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1782241367.362816:0:15661:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782241367.362827:0:15661:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782241367.362831:0:15661:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff890e81fc8000) has no exports 00000020:00000080:2.0:1782241367.405348:0:15661:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241367.405368:0:15661:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1782241367.405376:0:15661:0:(genops.c:906:class_export_put()) final put ffff890e77a74800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1782241367.405383:0:15661:0:(genops.c:865:class_export_destroy()) destroying export ffff890e77a74800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1782241367.405391:0:15661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1782241367.409634:0:15661:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff890e77a77000 00000020:01000000:2.0:1782241367.409681:0:15661:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1782241367.409690:0:15661:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782241367.409699:0:15661:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782241367.409704:0:15661:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff890e81744d40) has no exports 00000020:00000080:2.0:1782241367.409737:0:15661:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782241367.409751:0:15661:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1782241367.409779:0:15661:0:(genops.c:906:class_export_put()) final put ffff890e7d75a800/OSS_uuid 00000020:00000080:2.0:1782241367.409784:0:15661:0:(genops.c:865:class_export_destroy()) destroying export ffff890e7d75a800/OSS_uuid for OSS 00000020:01000000:2.0:1782241367.409794:0:15661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1782241367.409885:0:6506:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1782241367.409975:0:8746:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff890d46845a00:8746] 3 exiting: rc = 0 00000100:00100000:0.0:1782241367.410194:0:8426:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff890e7d576a00:8426] 2 exiting: rc = 0 00000100:00100000:0.0:1782241367.410307:0:8425:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff890e7d6cb600:8425] 1 exiting: rc = 0 00000100:00100000:0.0:1782241367.410382:0:8747:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff890e7d6d4600:8747] 4 exiting: rc = 0 00000100:00100000:0.0:1782241367.410462:0:8423:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff890e7d6cb400:8423] 0 exiting: rc = 1 00000100:00100000:2.0:1782241367.411972:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.411991:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.412011:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.412020:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.412031:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.412037:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418769:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418822:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418829:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418834:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418839:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418844:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418849:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418854:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418858:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418862:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418867:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418872:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418877:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418881:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418885:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418890:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418897:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418904:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418910:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418917:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418922:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418931:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418940:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418947:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418954:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418959:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418965:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418971:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418992:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.418998:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420205:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420215:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420222:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420238:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420245:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420251:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420257:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420262:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420268:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420274:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420280:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420286:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420291:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420297:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420302:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420307:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420312:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420330:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420337:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420342:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420347:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420353:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420359:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420364:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420369:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420375:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420380:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.420391:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.422091:0:8427:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff890e81649e00:8427] 0 exiting: rc = 1 00000100:00100000:0.0:1782241367.422185:0:14428:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff890d47bdf000:14428] 2 exiting: rc = 0 00000100:00100000:3.0:1782241367.426814:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff890e81648c00:8428] 1 exiting: rc = 0 00000100:00100000:2.0:1782241367.426993:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427009:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427016:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427021:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427025:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427041:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427046:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427051:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427056:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427061:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427066:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427071:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427076:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427080:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427085:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427090:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427095:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427100:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427105:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427110:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427115:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427120:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427124:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427129:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427134:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427139:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427144:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427149:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427154:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427158:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427162:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427167:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427172:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427193:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427199:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427204:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427209:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427214:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427219:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427224:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427237:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427242:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427247:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427254:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427259:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427264:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427268:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427274:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427279:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427285:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427292:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427297:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427302:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427307:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427312:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427326:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427332:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427338:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427343:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427348:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427354:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427358:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427363:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782241367.427385:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.445546:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff890e81420e00:8430] 1 exiting: rc = 0 00000100:00100000:0.0:1782241367.445906:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff890e81648800:8429] 0 exiting: rc = 1 00000100:00100000:0.0:1782241367.446106:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff890e6df7ec00:8431] 2 exiting: rc = 0 00000100:00100000:0.0:1782241367.446174:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446432:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446439:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446458:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446463:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446469:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446474:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446480:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446485:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446491:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446504:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446511:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446517:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446523:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446530:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446536:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446541:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446548:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446553:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446560:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446566:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446571:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446577:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446583:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446589:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446595:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446601:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446607:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446613:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446619:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446625:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446631:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446637:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446643:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446662:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446670:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446675:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446681:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446694:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446699:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446706:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446712:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446718:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446722:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446728:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446733:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446739:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446744:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446749:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446886:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446895:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446901:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446907:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446914:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446920:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446925:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446931:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446938:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446968:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446976:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446982:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446988:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.446995:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.447006:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782241367.463364:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff890e7d6d6c00:8433] 1 exiting: rc = 0 00000100:00100000:0.0:1782241367.463850:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff890e7d6d7200:8432] 0 exiting: rc = 1 00000100:00100000:0.0:1782241367.463913:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.463921:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.463927:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.463933:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.463938:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.463943:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.463967:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.463974:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.463991:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.463996:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464002:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464008:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464013:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464019:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464024:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464044:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464049:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464054:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464096:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464102:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464107:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464112:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464118:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464123:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464128:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464135:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464140:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464145:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464150:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464155:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464161:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464166:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464171:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464176:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464181:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464187:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464193:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464198:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464204:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464208:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464213:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464218:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464223:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464556:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464562:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464568:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464572:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464576:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464581:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464586:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464591:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464597:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464602:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464608:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464614:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464618:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464624:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464629:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464634:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464640:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464645:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464650:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464655:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.464667:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.468719:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff890e7d6c5000:8434] 0 exiting: rc = 1 00000100:00100000:0.0:1782241367.471374:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff890e7d6c4000:8435] 1 exiting: rc = 0 00000100:00100000:0.0:1782241367.471553:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.471578:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.471590:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.471599:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.471611:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.471625:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.471662:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.471674:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.471679:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.471685:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.471691:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.471697:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.471717:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.471723:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.471730:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.471738:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.472385:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.472397:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.472421:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.472432:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.472441:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.472452:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.472462:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.472474:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.472482:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.472494:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.472567:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.472783:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.472795:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.472803:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.473049:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.473058:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.473064:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.473071:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.473077:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.473083:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.473089:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.473096:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.473104:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.473111:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.473121:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.473130:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.473325:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.473342:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.473352:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.474412:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.474573:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.474910:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.475455:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.475784:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.475793:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.475799:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.475806:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.475812:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.475840:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.475847:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.475854:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.475859:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.475866:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.475871:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.475878:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.475883:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.475889:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782241367.475903:0:15661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1782241367.494014:0:15661:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1782241386.625383:0:16427:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1782241396.320173:0:17026:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782241396.320183:0:17026:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1782241396.320185:0:17026:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1782241396.320448:0:17026:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff890d48284800 00000020:01000004:3.0:1782241396.320526:0:17026:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1782241396.320539:0:17026:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1782241396.320560:0:17026:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff890d477019c0) 00000020:00000080:3.0:1782241396.320581:0:17026:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1782241396.418002:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1782241396.419368:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.422275:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.422524:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1782241396.422903:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.425999:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1782241396.426548:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1782241396.426882:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.427211:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1782241396.427451:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.427681:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.428114:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1782241396.428424:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.428634:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.429010:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1782241396.429684:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.430893:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.432885:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.433371:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.434373:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.435198:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1782241396.436214:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.436447:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1782241396.436911:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1782241396.437420:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1782241396.437613:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1782241396.438478:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.438690:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1782241396.440835:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.441436:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1782241396.441721:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1782241396.441986:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1782241396.442231:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1782241396.442422:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1782241396.448424:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1782241396.449337:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1782241396.449545:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1782241396.450147:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1782241396.450337:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1782241396.450529:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1782241396.451157:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1782241396.451369:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1782241396.451639:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1782241396.451857:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1782241396.452163:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1782241396.452348:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1782241396.452544:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1782241396.459530:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1782241396.462372:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1782241396.464225:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1782241396.466463:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1782241396.467359:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1782241396.467552:0:17026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:0.0:1782241396.468411:0:17026:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1782241396.468905:0:17026:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1782241396.468914:0:17026:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1782241396.468925:0:17026:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1a7a9 00000020:01000004:0.0:1782241396.468931:0:17026:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1782241396.468937:0:17026:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1782241396.468943:0:17026:0:(tgt_mount.c:101:server_register_mount()) register mount ffff890d48284800 from MGS 00000020:01000004:0.0:1782241396.468947:0:17026:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1782241396.468957:0:17026:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff890d467419c0) 00000020:00000080:0.0:1782241396.468967:0:17026:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1782241396.469171:0:17026:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890d48284800 from MGS, refs=2 00080000:01000000:0.0:1782241396.469176:0:17026:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1782241396.469181:0:17026:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1a7b7 00000100:00100000:0.0:1782241396.469661:0:17026:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1782241396.469836:0:17026:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1782241396.469843:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1782241396.471219:0:17026:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1782241396.471231:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1782241396.472222:0:17026:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782241396.472382:0:17026:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1782241396.472387:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1782241396.473273:0:17026:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1782241396.473281:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1782241396.473548:0:17026:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1782241396.473625:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1782241396.474741:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241396.474745:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241396.474790:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241396.475289:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241396.475293:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241396.475295:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241396.475865:0:17026:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1782241396.479059:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1782241396.484219:0:17026:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1782241396.486246:0:17038:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1782241396.486364:0:17026:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1782241396.486431:0:17026:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782241396.487386:0:17026:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1782241396.488095:0:17026:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782241396.488245:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1782241396.488251:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1782241396.491177:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1782241396.491190:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1782241396.491642:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1782241396.491649:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1782241396.501812:0:17026:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1782241396.501841:0:17026:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.158@tcp' 00000020:01000004:1.0:1782241396.501843:0:17026:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1782241396.501875:0:17026:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.158@tcp (typ=mgc) 00000020:00000080:1.0:1782241396.501890:0:17026:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.158@tcp (ffff890d4691cd40) 00000020:00000080:1.0:1782241396.501905:0:17026:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1782241396.502010:0:17026:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d48881000@MGC192.168.204.158@tcp: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241396.502178:0:17026:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.158@tcp-0 is initialized 00000040:01000000:1.0:1782241396.502183:0:17026:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.158@tcp ctxt 1 is initialized 00000100:00080000:0.0:1782241396.503904:0:17043:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1782241396.506268:0:17044:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1782241396.506880:0:17026:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.158@tcp (uuid f5d8e322-cb86-4bf4-a411-4939f9bbdcbb) 00000020:00000080:0.0:1782241396.506906:0:17026:0:(genops.c:1406:class_connect()) connect: client f5d8e322-cb86-4bf4-a411-4939f9bbdcbb, cookie 0xc9959f2fb1e1a7c5 00000100:00080000:0.0:1782241396.506933:0:17026:0:(import.c:512:import_select_connection()) MGC192.168.204.158@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782241396.506941:0:17026:0:(import.c:626:import_select_connection()) MGC192.168.204.158@tcp: import ffff890d48881000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241396.506975:0:17026:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e43f33800 x1868815140033536/t0(0) o250->MGC192.168.204.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241396.507002:0:17026:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import f5d8e322-cb86-4bf4-a411-4939f9bbdcbb->MGS 00000020:01000004:0.0:1782241396.507019:0:17026:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1782241396.507025:0:17026:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1782241396.507038:0:17026:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff890d46744d40) 00000020:00000080:0.0:1782241396.507050:0:17026:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1782241396.507236:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3636:1868815140033536:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1782241396.507319:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241396.507402:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140033536 00000100:00100000:2.0:1782241396.507409:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140033536 00000100:00100000:2.0:1782241396.507454:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241396.507461:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3636:x1868815140033536:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1782241396.507483:0:17041:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from f5d8e322-cb86-4bf4-a411-4939f9bbdcbb@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:2.0:1782241396.507507:0:17041:0:(genops.c:1406:class_connect()) connect: client f5d8e322-cb86-4bf4-a411-4939f9bbdcbb, cookie 0xc9959f2fb1e1a7d3 00000100:00080000:2.0:1782241396.507653:0:17041:0:(import.c:65:import_set_state_nolock()) ffff890e43609800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241396.507710:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+5:3636:x1868815140033536:12345-0@lo:250:mount.lustre.0 Request processed in 247us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241396.507718:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241396.507780:0:3636:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.158@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1782241396.507788:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.158@tcp: connect to target with instance 0 00000100:00080000:2.0:1782241396.507795:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.158@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1782241396.507799:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1782241396.507802:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d48881000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1782241396.507804:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1782241396.507811:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1782241396.507816:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3636:1868815140033536:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1782241396.520512:0:17026:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782241396.520727:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1782241396.520734:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1782241396.524451:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1782241396.524465:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1782241396.533466:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1782241396.533476:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1782241396.534600:0:17026:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782241396.534831:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1782241396.534837:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1782241396.535453:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1782241396.535460:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1782241396.570148:0:17026:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782241396.570407:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1782241396.570415:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1782241396.571620:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1782241396.571630:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1782241396.572406:0:17026:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782241396.572572:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782241396.572584:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1782241396.574375:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782241396.574385:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1782241396.575254:0:17026:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782241396.575414:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782241396.575419:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1782241396.575955:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782241396.575962:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1782241396.576508:0:17026:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782241396.576638:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782241396.576643:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1782241396.577226:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782241396.577233:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1782241396.598490:0:17026:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782241396.598699:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1782241396.598706:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1782241396.601606:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1782241396.601621:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1782241396.603906:0:17026:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1782241396.603920:0:17026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1782241396.606109:0:17026:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1782241396.606140:0:17026:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1782241396.606149:0:17026:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.158@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1782241396.606258:0:17026:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.158@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782241396.606293:0:17026:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.158@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1782241396.606298:0:17026:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782241396.606299:0:17026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782241396.606301:0:17026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241396.606302:0:17026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241396.606303:0:17026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241396.606305:0:17026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241396.606306:0:17026:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782241396.606307:0:17026:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782241396.606309:0:17026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241396.606310:0:17026:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782241396.606313:0:17026:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1782241396.606315:0:17026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782241396.606317:0:17026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782241396.606318:0:17026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241396.606319:0:17026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241396.606320:0:17026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241396.606321:0:17026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241396.606322:0:17026:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782241396.606324:0:17026:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782241396.606324:0:17026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241396.606326:0:17026:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782241396.606424:0:17026:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782241396.606446:0:17026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140033664:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782241396.606514:0:17026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241396.606613:0:17026:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46492840 going to sleep for 11 seconds 00000100:00100000:3.0:1782241396.606723:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140033664 00000100:00100000:3.0:1782241396.606732:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140033664 00000100:00100000:3.0:1782241396.607054:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782241396.607065:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+5:17026:x1868815140033664:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782241396.607102:0:17042:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782241396.607105:0:17042:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1782241396.607107:0:17042:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1782241396.608364:0:17063:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1782241396.609507:0:17042:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1782241396.612448:0:17064:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1782241396.612455:0:17064:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1782241396.612458:0:17064:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1782241396.612460:0:17064:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1782241396.612710:0:17064:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1782241396.618408:0:17042:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1782241396.618426:0:17042:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1782241396.622198:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+5:17026:x1868815140033664:12345-0@lo:253:mount.lustre.0 Request processed in 15126us (15674us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241396.622212:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241396.622497:0:17026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140033664:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782241396.622513:0:17026:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1782241396.622517:0:17026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782241396.622518:0:17026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782241396.622520:0:17026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241396.622531:0:17026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241396.622532:0:17026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241396.622534:0:17026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241396.622535:0:17026:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782241396.622537:0:17026:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782241396.622539:0:17026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241396.622540:0:17026:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782241396.622559:0:17026:0:(tgt_mount.c:101:server_register_mount()) register mount ffff890d48284800 from lustre-MDT0000 10000000:01000000:2.0:1782241396.622592:0:17026:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1782241396.622595:0:17026:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1782241396.622599:0:17026:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff890d4691cd40 10000000:01000000:2.0:1782241396.622604:0:17026:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782241396.622612:0:17026:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff890d4691cd40 from 1 10000000:01000000:2.0:1782241396.622615:0:17026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782241396.623010:0:17026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241396.623022:0:17026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241396.623031:0:17026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241396.623050:0:17026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140033792:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782241396.623089:0:17026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241396.623128:0:17026:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e46492e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241396.623201:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140033792 00000100:00100000:1.0:1782241396.623208:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140033792 00000100:00100000:1.0:1782241396.623254:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782241396.623264:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+5:17026:x1868815140033792:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241396.623278:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241396.623293:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779eaa00/0xc9959f2fb1e1a7e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1a7da expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.623316:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779eaa00/0xc9959f2fb1e1a7e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a7da expref: 6 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.623327:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779eaa00/0xc9959f2fb1e1a7e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a7da expref: 6 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.623348:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eaa00, rc 0) 00000100:00100000:1.0:1782241396.623391:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+6:17026:x1868815140033792:12345-0@lo:101:mount.lustre.0 Request processed in 128us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241396.623397:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782241396.623536:0:17026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140033792:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241396.623550:0:17026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7e1 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.623560:0:17026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a7e1 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241396.623876:0:17026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140033920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241396.623908:0:17026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241396.623972:0:17026:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48c41480 going to sleep for 11 seconds 00000100:00100000:3.0:1782241396.624814:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140033920 00000100:00100000:3.0:1782241396.624824:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140033920 00000100:00100000:3.0:1782241396.624982:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782241396.624992:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+6:17026:x1868815140033920:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241396.625114:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+6:17026:x1868815140033920:12345-0@lo:501:mount.lustre.0 Request processed in 124us (1205us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782241396.625122:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782241396.625220:0:17026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140033920:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1782241396.625256:0:17026:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782241396.625277:0:17026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7e1 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.625286:0:17026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7e1 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241396.625295:0:17026:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff890d48284800 10000000:01000000:0.0:1782241396.625299:0:17026:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782241396.625304:0:17026:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff890d48284800 10000000:01000000:0.0:1782241396.625306:0:17026:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1782241396.625309:0:17026:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff890d48284800 from 1 10000000:01000000:0.0:1782241396.625316:0:17026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1782241396.625343:0:17026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.625352:0:17026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.625359:0:17026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241396.625375:0:17026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140034048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782241396.625404:0:17026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241396.625425:0:17026:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48c41480 going to sleep for 11 seconds 00000100:00100000:3.0:1782241396.625539:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140034048 00000100:00100000:3.0:1782241396.625545:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140034048 00000100:00100000:3.0:1782241396.625564:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782241396.625570:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+6:17026:x1868815140034048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241396.625578:0:17042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241396.625590:0:17042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e1a7ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1a7e8 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241396.625608:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e1a7ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a7e8 expref: 7 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241396.625617:0:17042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164c400/0xc9959f2fb1e1a7ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a7e8 expref: 7 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241396.625641:0:17042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c400, rc 0) 00000100:00100000:3.0:1782241396.625678:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+7:17026:x1868815140034048:12345-0@lo:101:mount.lustre.0 Request processed in 108us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241396.625684:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782241396.625966:0:17026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140034048:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241396.625979:0:17026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7ef expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.625987:0:17026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a7ef expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241396.625998:0:17026:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1782241396.626012:0:17026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7ef expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.626018:0:17026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e778f1800/0xc9959f2fb1e1a7e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7ef expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241396.626024:0:17026:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1782241396.626027:0:17026:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782241396.626040:0:17026:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff890d48284800 10000000:01000000:0.0:1782241396.626042:0:17026:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1782241396.626045:0:17026:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1782241396.626047:0:17026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782241396.626062:0:17026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.626069:0:17026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.626076:0:17026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241396.626088:0:17026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140034176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782241396.626112:0:17026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241396.626129:0:17026:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48c41480 going to sleep for 11 seconds 00000100:00100000:3.0:1782241396.626187:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140034176 00000100:00100000:3.0:1782241396.626192:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140034176 00000100:00100000:3.0:1782241396.626212:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782241396.626218:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+7:17026:x1868815140034176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241396.626225:0:17042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241396.626233:0:17042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e1a7fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1a7f6 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241396.626262:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e1a7fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a7f6 expref: 8 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241396.626270:0:17042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164de00/0xc9959f2fb1e1a7fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a7f6 expref: 8 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241396.626276:0:17042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164de00, rc 0) 00000100:00100000:3.0:1782241396.626315:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+8:17026:x1868815140034176:12345-0@lo:101:mount.lustre.0 Request processed in 97us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241396.626322:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782241396.626438:0:17026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140034176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241396.626449:0:17026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7fd expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.626455:0:17026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a7fd expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241396.626504:0:17026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140034304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241396.626528:0:17026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241396.626547:0:17026:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48c41480 going to sleep for 11 seconds 00000100:00100000:2.0:1782241396.626613:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140034304 00000100:00100000:2.0:1782241396.626618:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140034304 00000100:00100000:2.0:1782241396.626797:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782241396.626805:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+8:17026:x1868815140034304:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241396.627007:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+9:17026:x1868815140034304:12345-0@lo:501:mount.lustre.0 Request processed in 202us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241396.627026:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782241396.627104:0:17026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140034304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241396.627132:0:17026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140034432:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782241396.627185:0:17026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241396.627204:0:17026:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48c41480 going to sleep for 11 seconds 00000100:00100000:1.0:1782241396.628401:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140034432 00000100:00100000:1.0:1782241396.628413:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140034432 00000100:00100000:1.0:1782241396.628455:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782241396.628465:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+9:17026:x1868815140034432:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782241396.631699:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+9:17026:x1868815140034432:12345-0@lo:503:mount.lustre.0 Request processed in 3224us (4502us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241396.631714:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241396.631807:0:17026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140034432:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241396.634370:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17065:1868815140034560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241396.634457:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241396.634502:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48527600 going to sleep for 11 seconds 00000100:00100000:2.0:1782241396.634961:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140034560 00000100:00100000:2.0:1782241396.634969:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140034560 00000100:00100000:2.0:1782241396.635016:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782241396.635026:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+9:17065:x1868815140034560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241396.637056:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+9:17065:x1868815140034560:12345-0@lo:502:llog_process_th.0 Request processed in 2021us (2588us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241396.637073:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782241396.637236:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17065:1868815140034560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782241396.637275:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241396.637287:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241396.637290:0:17065:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782241396.637295:0:17065:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1782241396.637298:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782241396.637312:0:17065:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff890d47704d40) 00000020:00000080:3.0:1782241396.637330:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1782241396.637335:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1782241396.637417:0:17065:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1782241396.637424:0:17065:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1a80b 00000020:00000080:3.0:1782241396.637649:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1782241396.637653:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241396.637657:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241396.637666:0:17065:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782241396.637670:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241396.637674:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241396.637675:0:17065:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1782241396.637678:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782241396.637685:0:17065:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff890d47700000) 00000020:00000080:3.0:1782241396.637694:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1782241396.637698:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1782241396.637700:0:17065:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1782241396.637702:0:17065:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1782241396.637708:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782241396.637792:0:17065:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890d48284800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1782241396.637806:0:17065:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff890d47703380) 00000020:00000080:3.0:1782241396.637814:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1782241396.637874:0:17065:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1782241396.637879:0:17065:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e1a820 00000020:00000080:3.0:1782241396.637984:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1782241396.637991:0:17065:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1782241396.637995:0:17065:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc9959f2fb1e1a827 00080000:01000000:3.0:1782241396.638000:0:17065:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1782241396.638003:0:17065:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1a82e 00010000:00010000:3.0:1782241396.695297:0:17065:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1782241396.696870:0:17065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967530 00000001:00080000:3.0:1782241396.697445:0:17065:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1782241396.697981:0:17065:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff890e77d9cd40) 00000020:00000080:3.0:1782241396.697999:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1782241396.698075:0:17065:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1782241396.698083:0:17065:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1a83c 00000020:00000080:3.0:1782241396.698872:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1782241396.701418:0:17065:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc9959f2fb1e1a843 00000020:00000080:3.0:1782241396.701840:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1782241396.701851:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241396.701864:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241396.701866:0:17065:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1782241396.701869:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1782241396.701872:0:17065:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1782241396.701874:0:17065:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782241396.701875:0:17065:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782241396.701876:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1782241396.701879:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241396.701880:0:17065:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1782241396.701882:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241396.701888:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241396.701889:0:17065:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1782241396.701893:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1782241396.701943:0:17065:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1782241396.701959:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241396.701962:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241396.701963:0:17065:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1782241396.701966:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241396.701969:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241396.701971:0:17065:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1782241396.701974:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782241396.701980:0:17065:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:00000080:3.0:1782241396.702007:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782241396.702027:0:17065:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff890e77d98000) 00000020:00000080:3.0:1782241396.702040:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1782241396.702046:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782241396.702110:0:17065:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1782241396.702116:0:17065:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1782241396.702121:0:17065:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1a851 00010000:00080000:3.0:1782241396.702152:0:17065:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890e7d549000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.158@tcp at head 00010000:00010000:3.0:1782241396.706580:0:17065:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1782241396.710417:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782241396.710435:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1782241396.710475:0:17065:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1782241396.710497:0:17065:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e1a858 00000100:00080000:1.0:1782241396.710509:0:17065:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782241396.710515:0:17065:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff890e7d549000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241396.710558:0:17065:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a49500 x1868815140034688/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241396.710587:0:17065:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1782241396.710649:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241396.710653:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241396.710655:0:17065:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1782241396.710658:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782241396.710660:0:17065:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1782241396.710662:0:17065:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782241396.710664:0:17065:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782241396.710673:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782241396.710676:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241396.710677:0:17065:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782241396.710680:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782241396.710686:0:17065:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1782241396.710690:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241396.710691:0:17065:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1782241396.710694:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782241396.710698:0:17065:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:01000000:1.0:1782241396.710723:0:17065:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782241396.710726:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782241396.710739:0:17065:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff890d469199c0) 00000020:00000080:1.0:1782241396.710782:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1782241396.710789:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782241396.710846:0:17065:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1782241396.710852:0:17065:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1782241396.710858:0:17065:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1a866 00010000:00080000:1.0:1782241396.710885:0:17065:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890e77aae000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241396.711148:0:17065:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1782241396.711463:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140034688:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782241396.711530:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241396.711823:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140034688 00000100:00100000:0.0:1782241396.711831:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140034688 00000100:00100000:0.0:1782241396.711904:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782241396.711912:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140034688:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1782241396.711928:0:17052:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1782241396.712576:0:17065:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1782241396.712834:0:17065:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1782241396.719845:0:17065:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782241396.722600:0:17065:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1782241396.723341:0:17065:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1782241396.725134:0:17071:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782241396.725141:0:17071:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1782241396.726888:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782241396.726902:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782241396.727018:0:17065:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1782241396.727042:0:17065:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e1a86d 00000100:00080000:1.0:1782241396.727054:0:17065:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782241396.727061:0:17065:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff890e77aae000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241396.727302:0:17065:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a4a680 x1868815140034816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782241396.727374:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140034816:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1782241396.727459:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140034816 offset 0 length 520: 4 00000100:00080000:1.0:1782241396.727519:0:17065:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1782241396.727583:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241396.727588:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241396.727591:0:17065:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1782241396.727594:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782241396.727596:0:17065:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1782241396.727598:0:17065:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782241396.727600:0:17065:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782241396.727602:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782241396.727604:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241396.727606:0:17065:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782241396.727608:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782241396.727613:0:17065:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1782241396.727616:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241396.727617:0:17065:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1782241396.727620:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782241396.727624:0:17065:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:01000000:1.0:1782241396.727645:0:17065:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782241396.727647:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782241396.727671:0:17065:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff890d4691b380) 00000020:00000080:1.0:1782241396.727683:0:17065:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1782241396.727688:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782241396.727780:0:17065:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1782241396.727786:0:17065:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1782241396.727792:0:17065:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9959f2fb1e1a87b 00010000:00080000:1.0:1782241396.727821:0:17065:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890e67fa6000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241396.728038:0:17065:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1782241396.728123:0:17065:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1782241396.728140:0:17065:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782241396.733958:0:17065:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782241396.734301:0:17065:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1782241396.734917:0:17065:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1782241396.735494:0:17073:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1782241396.735501:0:17073:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1782241396.741376:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140034688:12345-0@lo:38:llog_process_th.0 Request processed in 29454us (29835us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782241396.741395:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1782241396.743135:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7d549000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782241396.743145:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782241396.743150:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140034688:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1782241396.745956:0:17065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782241396.745971:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782241396.746032:0:17065:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1782241396.746053:0:17065:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e1a882 00000100:00080000:3.0:1782241396.746064:0:17065:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782241396.746070:0:17065:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff890e67fa6000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241396.746103:0:17065:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48137480 x1868815140034944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782241396.746132:0:17065:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1782241396.746191:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241396.746196:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241396.746197:0:17065:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1782241396.746201:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241396.746204:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241396.746205:0:17065:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782241396.746209:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782241396.746211:0:17065:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1782241396.746213:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241396.746215:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241396.746216:0:17065:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1782241396.746219:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241396.746221:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241396.746222:0:17065:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782241396.746226:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782241396.746260:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17065:1868815140035072:0@lo:502:llog_process_th.0 00000100:00080000:0.0:1782241396.746338:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:3.0:1782241396.746342:0:17065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782241396.746342:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1782241396.746345:0:36:0:(import.c:65:import_set_state_nolock()) ffff890e7d549000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241396.746349:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:0.0:1782241396.746353:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782241396.746356:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff890e7d549000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241396.746368:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e43f31f80 x1868815140035328/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782241396.746374:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48d1d9c0 going to sleep for 11 seconds 00000100:00080000:0.0:1782241396.746377:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241396.746380:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782241396.746434:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140035200:0@lo:400:kworker.0 00000100:00100000:0.0:1782241396.746462:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241396.746565:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140034944:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1782241396.746603:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140034944 offset 0 length 520: 4 00000100:00100000:2.0:1782241396.746617:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140035328:0@lo:38:kworker.0 00000100:00100000:2.0:1782241396.746639:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241396.746685:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140035328 00000100:00100000:2.0:1782241396.746691:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140035328 00000100:00100000:2.0:1782241396.746733:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241396.746740:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1868815140035328:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1782241396.746782:0:17053:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1782241396.746823:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1868815140035328:12345-0@lo:38:kworker.0 Request processed in 81us (182us total) trans 0 rc -19/-19 00000100:00100000:2.0:1782241396.746830:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782241396.746833:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140035072 00000100:00100000:3.0:1782241396.746836:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140035072 00000100:00080000:2.0:1782241396.746860:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7d549000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1782241396.746863:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140035200 00000100:00080000:2.0:1782241396.746864:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782241396.746865:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140035200 00000100:00100000:2.0:1782241396.746868:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140035328:0@lo:38:kworker.0 00000100:00100000:3.0:1782241396.746884:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782241396.746890:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+10:17065:x1868815140035072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782241396.746890:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782241396.746895:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+10:3638:x1868815140035200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241396.746944:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+10:3638:x1868815140035200:12345-0@lo:400:kworker.0 Request processed in 48us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241396.746950:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782241396.746984:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140035200:0@lo:400:kworker.0 00000100:00100000:3.0:1782241396.746989:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+9:17065:x1868815140035072:12345-0@lo:502:llog_process_th.0 Request processed in 100us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241396.746996:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782241396.747032:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17065:1868815140035072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782241396.747053:0:17065:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241396.747058:0:17065:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241396.747060:0:17065:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782241396.747063:0:17065:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1782241396.747540:0:17026:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1782241396.747560:0:17026:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782241396.747581:0:17026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7fd expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241396.747591:0:17026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e778f1a00/0xc9959f2fb1e1a7f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7fd expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241396.747599:0:17026:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d48284800 from 1 10000000:01000000:2.0:1782241396.747601:0:17026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782241396.747635:0:17026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1a889 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241396.747650:0:17026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1a889 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241396.747660:0:17026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1a889 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241396.747676:0:17026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140035456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782241396.747706:0:17026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241396.747736:0:17026:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa000 going to sleep for 11 seconds 00000100:00100000:0.0:1782241396.747812:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140035456 00000100:00100000:0.0:1782241396.747821:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140035456 00000100:00100000:0.0:1782241396.747858:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782241396.747865:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+9:17026:x1868815140035456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241396.747874:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241396.747887:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e778f1000/0xc9959f2fb1e1a890 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1a889 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.747906:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e778f1000/0xc9959f2fb1e1a890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a889 expref: 10 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.747916:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e778f1000/0xc9959f2fb1e1a890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a889 expref: 10 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.747933:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1000, rc 0) 00000100:00100000:0.0:1782241396.747971:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+10:17026:x1868815140035456:12345-0@lo:101:mount.lustre.0 Request processed in 106us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241396.747978:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782241396.748099:0:17026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140035456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782241396.748112:0:17026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1a889 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a890 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241396.748120:0:17026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1a889 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a890 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241396.748683:0:17026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140035584:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1782241396.748723:0:17026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241396.748794:0:17026:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa000 going to sleep for 11 seconds 00000100:00100000:1.0:1782241396.748794:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140035584 00000100:00100000:1.0:1782241396.748799:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140035584 00000100:00100000:1.0:1782241396.748832:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782241396.748840:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+10:17026:x1868815140035584:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1782241396.748855:0:17039:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1782241396.748861:0:17039:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1782241396.748937:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+10:17026:x1868815140035584:12345-0@lo:256:mount.lustre.0 Request processed in 98us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241396.748944:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782241396.748958:0:17026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140035584:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1782241396.749563:0:17026:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782241396.749572:0:17026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1a889 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a890 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.749581:0:17026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1a889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a890 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241396.749588:0:17026:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890d48284800 from 1 10000000:01000000:0.0:1782241396.749590:0:17026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782241396.749613:0:17026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f0000/0xc9959f2fb1e1a897 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.749653:0:17026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e778f0000/0xc9959f2fb1e1a897 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.749662:0:17026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e778f0000/0xc9959f2fb1e1a897 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241396.749677:0:17026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140035712:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782241396.749710:0:17026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241396.749782:0:17026:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241396.749812:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140035712 00000100:00100000:1.0:1782241396.749817:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140035712 00000100:00100000:1.0:1782241396.749851:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782241396.749859:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+10:17026:x1868815140035712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241396.749867:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241396.749879:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1a89e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1a897 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.749896:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1a89e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a897 expref: 11 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.749905:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1a89e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a897 expref: 11 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.749926:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb600, rc 0) 00000100:00100000:1.0:1782241396.749973:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+11:17026:x1868815140035712:12345-0@lo:101:mount.lustre.0 Request processed in 114us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241396.749979:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782241396.750133:0:17026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140035712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241396.750145:0:17026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e778f0000/0xc9959f2fb1e1a897 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a89e expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.750152:0:17026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e778f0000/0xc9959f2fb1e1a897 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a89e expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241396.750216:0:17026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140035840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241396.750241:0:17026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241396.750267:0:17026:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241396.750310:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140035840 00000100:00100000:1.0:1782241396.750314:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140035840 00000100:00100000:1.0:1782241396.750351:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782241396.750357:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+11:17026:x1868815140035840:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241396.750490:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+11:17026:x1868815140035840:12345-0@lo:501:mount.lustre.0 Request processed in 133us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241396.750497:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782241396.750510:0:17026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140035840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241396.750540:0:17026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140035968:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782241396.750578:0:17026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241396.750602:0:17026:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aae40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241396.750647:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140035968 00000100:00100000:1.0:1782241396.750651:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140035968 00000100:00100000:1.0:1782241396.750682:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782241396.750688:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+11:17026:x1868815140035968:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782241396.750939:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+11:17026:x1868815140035968:12345-0@lo:503:mount.lustre.0 Request processed in 249us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241396.750946:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782241396.753102:0:17026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140035968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782241396.754313:0:17075:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17075:1868815140036096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241396.754384:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241396.755574:0:17075:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8780 going to sleep for 11 seconds 00000100:00100000:1.0:1782241396.755650:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140036096 00000100:00100000:1.0:1782241396.755658:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140036096 00000100:00100000:1.0:1782241396.755712:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782241396.755722:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+11:17075:x1868815140036096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241396.758128:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+11:17075:x1868815140036096:12345-0@lo:502:llog_process_th.0 Request processed in 2400us (3737us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241396.758142:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782241396.758382:0:17075:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17075:1868815140036096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782241396.758417:0:17075:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782241396.758427:0:17075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241396.758436:0:17075:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782241396.758443:0:17075:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890d48284800 00000020:00000080:0.0:1782241396.758446:0:17075:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782241396.758455:0:17075:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241396.758458:0:17075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241396.758459:0:17075:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782241396.758462:0:17075:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782241396.758464:0:17075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241396.758465:0:17075:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782241396.758468:0:17075:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890d48284800 00000020:00000080:0.0:1782241396.758470:0:17075:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782241396.758527:0:17075:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241396.758530:0:17075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241396.758532:0:17075:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1782241396.758534:0:17075:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782241396.758537:0:17075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241396.758538:0:17075:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782241396.758541:0:17075:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890d48284800 00000020:00000080:0.0:1782241396.758544:0:17075:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782241396.758559:0:17075:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241396.758562:0:17075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241396.758563:0:17075:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782241396.758565:0:17075:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782241396.758567:0:17075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241396.758569:0:17075:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1782241396.758572:0:17075:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890d48284800 00000020:00000080:0.0:1782241396.758574:0:17075:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782241396.758620:0:17075:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17075:1868815140036224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782241396.758668:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241396.758789:0:17075:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8780 going to sleep for 11 seconds 00000100:00100000:1.0:1782241396.759526:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140036224 00000100:00100000:1.0:1782241396.759535:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140036224 00000100:00100000:1.0:1782241396.759621:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782241396.759630:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+11:17075:x1868815140036224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782241396.759775:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+11:17075:x1868815140036224:12345-0@lo:502:llog_process_th.0 Request processed in 127us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241396.759782:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782241396.759870:0:17075:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17075:1868815140036224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782241396.759896:0:17075:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241396.759914:0:17075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241396.759916:0:17075:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1782241396.759920:0:17075:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1782241396.760947:0:17026:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1782241396.760974:0:17026:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782241396.760999:0:17026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f0000/0xc9959f2fb1e1a897 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a89e expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.761016:0:17026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e778f0000/0xc9959f2fb1e1a897 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a89e expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241396.761074:0:17026:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782241396.761077:0:17026:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff890d48284800 10000000:01000000:0.0:1782241396.761080:0:17026:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff890d48284800 10000000:01000000:0.0:1782241396.761084:0:17026:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782241396.761089:0:17026:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890d48284800 from 1 10000000:01000000:0.0:1782241396.761092:0:17026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782241396.761123:0:17026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.761132:0:17026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.761142:0:17026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241396.761174:0:17026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140036352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782241396.761414:0:17026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241396.761444:0:17026:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241396.761568:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140036352 00000100:00100000:1.0:1782241396.761576:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140036352 00000100:00100000:1.0:1782241396.761617:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782241396.761626:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+11:17026:x1868815140036352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241396.761637:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241396.761649:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779eb200/0xc9959f2fb1e1a8ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1a8a5 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.761669:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779eb200/0xc9959f2fb1e1a8ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a8a5 expref: 12 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.761679:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779eb200/0xc9959f2fb1e1a8ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a8a5 expref: 12 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.761687:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb200, rc 0) 00000100:00100000:1.0:1782241396.761723:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17026:x1868815140036352:12345-0@lo:101:mount.lustre.0 Request processed in 97us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241396.761729:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782241396.761845:0:17026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140036352:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241396.761860:0:17026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a8ac expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241396.761869:0:17026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a8ac expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241396.761941:0:17026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140036480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241396.761967:0:17026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241396.761991:0:17026:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241396.762346:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140036480 00000100:00100000:1.0:1782241396.762350:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140036480 00000100:00100000:1.0:1782241396.762376:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782241396.762383:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e505a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17026:x1868815140036480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241396.762515:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e505a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17026:x1868815140036480:12345-0@lo:501:mount.lustre.0 Request processed in 131us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241396.762522:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782241396.762554:0:17026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140036480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241396.762582:0:17026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140036608:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782241396.762624:0:17026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241396.762644:0:17026:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863180 going to sleep for 11 seconds 00000100:00100000:1.0:1782241396.762658:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140036608 00000100:00100000:1.0:1782241396.762662:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140036608 00000100:00100000:1.0:1782241396.762680:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782241396.762686:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e505a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17026:x1868815140036608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782241396.762793:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e505a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17026:x1868815140036608:12345-0@lo:503:mount.lustre.0 Request processed in 106us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241396.762800:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782241396.762839:0:17026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140036608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241396.765589:0:17077:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17077:1868815140036736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241396.765660:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241396.765693:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140036736 00000100:00100000:3.0:1782241396.765699:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140036736 00000100:00100000:3.0:1782241396.765738:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782241396.765784:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e505a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17077:x1868815140036736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241396.765895:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e505a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17077:x1868815140036736:12345-0@lo:502:llog_process_th.0 Request processed in 113us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241396.768308:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782241396.768398:0:17077:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241396.768430:0:17077:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17077:1868815140036736:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1782241396.768506:0:17077:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1782241396.768523:0:17077:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff890e77d9b380) 00000020:00000080:3.0:1782241396.768541:0:17077:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1782241396.768704:0:17077:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890d48284800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782241396.768708:0:17077:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890d48284800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782241396.768710:0:17077:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890d48284800 4 00010000:00080000:3.0:1782241396.768737:0:17077:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d48035000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.158@tcp at head 00010000:00010000:3.0:1782241396.777020:0:17077:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1782241396.777123:0:17077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1782241396.780323:0:17077:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782241396.780341:0:17077:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc9959f2fb1e1a8ba 00000100:00080000:3.0:1782241396.780353:0:17077:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782241396.780359:0:17077:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff890d48035000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241396.780392:0:17077:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48135180 x1868815140036864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782241396.780425:0:17077:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1782241396.780459:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241396.780464:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782241396.780670:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1868815140036864:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782241396.780776:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241396.780950:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140036864 00000100:00100000:3.0:1782241396.780959:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140036864 00000100:00100000:3.0:1782241396.781032:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782241396.781040:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140036864:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782241396.781099:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140036864:12345-0@lo:38:llog_process_th.0 Request processed in 57us (356us total) trans 0 rc -11/-11 00000100:00100000:3.0:1782241396.781107:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782241396.788337:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782241396.788352:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d48035000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782241396.788368:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1782241396.788374:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1868815140036864:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782241396.788567:0:17077:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17077:1868815140036992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241396.788834:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241396.788873:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140036992 00000100:00100000:3.0:1782241396.788878:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140036992 00000100:00100000:3.0:1782241396.788934:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782241396.788944:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e505a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17077:x1868815140036992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241396.789060:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e505a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17077:x1868815140036992:12345-0@lo:502:llog_process_th.0 Request processed in 117us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241396.789079:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782241396.789140:0:17077:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241396.789155:0:17077:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17077:1868815140036992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241396.789194:0:17077:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17077:1868815140037120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241396.789224:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241396.789241:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140037120 00000100:00100000:3.0:1782241396.789244:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140037120 00000100:00100000:3.0:1782241396.789262:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782241396.789267:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e820d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17077:x1868815140037120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782241396.789321:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e820d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17077:x1868815140037120:12345-0@lo:502:llog_process_th.0 Request processed in 53us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241396.789329:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782241396.789363:0:17077:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241396.789377:0:17077:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17077:1868815140037120:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782241396.789402:0:17077:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1782241396.789456:0:17026:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1782241396.789482:0:17026:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782241396.789506:0:17026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a8ac expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241396.789517:0:17026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e778f1400/0xc9959f2fb1e1a8a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a8ac expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782241396.790159:0:17026:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782241396.790162:0:17026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782241396.790163:0:17026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241396.790165:0:17026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241396.790166:0:17026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241396.790168:0:17026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241396.790170:0:17026:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241396.790171:0:17026:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782241396.790173:0:17026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241396.790174:0:17026:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782241396.790177:0:17026:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1782241396.790180:0:17026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782241396.790181:0:17026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782241396.790182:0:17026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241396.790183:0:17026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241396.790184:0:17026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241396.790185:0:17026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241396.790186:0:17026:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241396.790187:0:17026:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782241396.790188:0:17026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241396.790189:0:17026:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782241396.790205:0:17026:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782241396.790215:0:17026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140037248:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782241396.790251:0:17026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241396.790274:0:17026:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67f723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241396.790291:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140037248 00000100:00100000:3.0:1782241396.790301:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140037248 00000100:00100000:3.0:1782241396.790328:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782241396.790335:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e820d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17026:x1868815140037248:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782241396.790353:0:17041:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1782241396.790365:0:17041:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782241396.795468:0:17041:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782241396.795488:0:17041:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1782241396.795512:0:17063:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782241396.795517:0:17063:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782241396.795540:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e779ea600/0xc9959f2fb1e1a8c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.795558:0:17063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e778f1000/0xc9959f2fb1e1a890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a889 expref: 12 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.795567:0:17063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e779ea600/0xc9959f2fb1e1a8c1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.795604:0:17063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e778f1000/0xc9959f2fb1e1a890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1a889 expref: 12 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.795619:0:17063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e778f1000/0xc9959f2fb1e1a890 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a889 expref: 12 pid: 17041 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241396.795645:0:17063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1868815140037376:0@lo:104: 00000100:00100000:1.0:1782241396.795712:0:17063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241396.795782:0:17063:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77863f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782241396.795795:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140037376 00000100:00100000:2.0:1782241396.795807:0:17030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140037376 00000100:00100000:2.0:1782241396.795862:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241396.795873:0:17030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+3:17063:x1868815140037376:12345-0@lo:104: 00010000:00010000:2.0:1782241396.795887:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1a889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1a890 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241396.795957:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782241396.795976:0:17030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+3:17063:x1868815140037376:12345-0@lo:104: Request processed in 104us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241396.795983:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1782241396.796010:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241396.796016:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1a889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1a890 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241396.796024:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860e00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241396.796027:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1a889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1a890 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241396.796036:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1a889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1a890 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241396.796036:0:17063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1868815140037376:0@lo:104: 10000000:00010000:2.0:1782241396.796043:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1a889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1a890 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241396.796049:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782241396.796053:0:17063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e779ea600/0xc9959f2fb1e1a8c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241396.796072:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e820d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17026:x1868815140037248:12345-0@lo:253:mount.lustre.0 Request processed in 5735us (5818us total) trans 0 rc 0/0 00010000:00010000:2.0:1782241396.796080:0:17036:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1a889 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a890 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241396.796083:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1782241396.796092:0:17036:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782241396.796127:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1a889 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a890 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241396.796131:0:17026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17026:1868815140037248:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782241396.796144:0:17026:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00010000:00010000:2.0:1782241396.796145:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1a889 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a890 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782241396.796150:0:17026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782241396.796153:0:17026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782241396.796156:0:17026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241396.796158:0:17026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241396.796159:0:17026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241396.796161:0:17026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241396.796162:0:17026:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241396.796164:0:17026:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782241396.796166:0:17026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241396.796167:0:17026:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1782241396.796167:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241396.796172:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241396.796175:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000000:3.0:1782241396.796179:0:17026:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1782241396.796212:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140037504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241396.796243:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241396.796293:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140037504 00000100:00100000:1.0:1782241396.796298:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140037504 00010000:00010000:1.0:1782241396.796314:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e778f1000/0xc9959f2fb1e1a890 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a889 expref: 12 pid: 17041 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241396.796343:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241396.796350:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:3639:x1868815140037504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241396.796360:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241396.796365:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e778f1000/0xc9959f2fb1e1a890 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a889 expref: 12 pid: 17041 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.796374:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e778f1000/0xc9959f2fb1e1a890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a889 expref: 12 pid: 17041 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.796397:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e778f1000/0xc9959f2fb1e1a890 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1a889 expref: 12 pid: 17041 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.796409:0:17032:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e779ea600/0xc9959f2fb1e1a8c1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.796416:0:17032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779ea600/0xc9959f2fb1e1a8c1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782241396.796434:0:17032:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000917813s 00010000:00010000:1.0:1782241396.796439:0:17032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e779ea600/0xc9959f2fb1e1a8c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.796445:0:17032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e779ea600/0xc9959f2fb1e1a8c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.796450:0:17032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e779ea600/0xc9959f2fb1e1a8c1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.796456:0:17032:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e779ea600/0xc9959f2fb1e1a8c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.796461:0:17032:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241396.796465:0:17032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e779ea600/0xc9959f2fb1e1a8c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.796472:0:17032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e779ea600/0xc9959f2fb1e1a8c1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.796485:0:17032:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e779ea600/0xc9959f2fb1e1a8c1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.796494:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241396.796534:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+11:3639:x1868815140037504:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241396.796540:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1782241396.796558:0:17063:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e779ea600/0xc9959f2fb1e1a8c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241396.796574:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140037504:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241396.796576:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e779ea600/0xc9959f2fb1e1a8c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241396.796582:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779ea600/0xc9959f2fb1e1a8c1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1782241396.812373:0:17026:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1782241396.813076:0:17026:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1782241396.813276:0:17087:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1782241396.813280:0:17087:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1782241396.813483:0:17088:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1782241396.813819:0:17088:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1782241396.815244:0:17026:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1782241396.815826:0:17088:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1782241396.815888:0:17088:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:1.0:1782241396.816689:0:17089:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff890d45a49500 x1868815140037632/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241396.816702:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00000040:01000000:0.0:1782241396.817658:0:17026:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1782241396.817703:0:17026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1782241396.819164:0:17026:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1782241396.819177:0:17026:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1782241396.819241:0:17026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782241396.820716:0:17026:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1782241396.821640:0:17026:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1782241396.821843:0:17026:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1782241396.823599:0:17026:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1782241396.825446:0:17026:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1782241396.827349:0:17026:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1782241396.827383:0:17026:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa60ac19f3988 00100000:10000000:0.0:1782241396.827390:0:17026:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1782241396.828250:0:17026:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782241396.828265:0:17026:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.158@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782241396.828283:0:17026:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1782241396.828306:0:17026:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1782241396.836206:0:17026:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782241396.836493:0:17026:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782241397.510353:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782241397.639065:0:17044:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782241397.639073:0:17044:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d48284800 from 7 10000000:01000000:2.0:1782241397.639077:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782241397.639126:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a8c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241397.639136:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a8c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241397.639159:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a8c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241397.639188:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140037760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782241397.639261:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241397.639316:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4898c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241397.639426:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140037760 00000100:00100000:3.0:1782241397.639439:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140037760 00000100:00100000:3.0:1782241397.639495:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782241397.639503:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4c44c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+11:17044:x1868815140037760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241397.639515:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241397.639527:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1a8cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1a8c8 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241397.639558:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1a8cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a8c8 expref: 12 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241397.639568:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1a8cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a8c8 expref: 12 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241397.639577:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d000, rc 0) 00000100:00100000:3.0:1782241397.639626:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4c44c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17044:x1868815140037760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241397.639633:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782241397.639901:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140037760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241397.639928:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a8c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a8cf expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241397.639937:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a8c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a8cf expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241397.639981:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140037888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782241397.640011:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241397.640037:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4898c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241397.640132:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140037888 00000100:00100000:1.0:1782241397.640137:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140037888 00000100:00100000:1.0:1782241397.640240:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782241397.640247:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4c44c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17044:x1868815140037888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1782241397.640260:0:17041:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782241397.640275:0:17041:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782241397.640279:0:17041:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1782241397.640345:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4c44c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17044:x1868815140037888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 99us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241397.640352:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782241397.640447:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140037888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1782241397.640485:0:17044:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782241397.640491:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a8c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a8cf expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241397.640499:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a8c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a8cf expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241397.830880:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00000040:00080000:3.0:1782241397.838786:0:17085:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782241398.532994:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782241398.855481:0:17085:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782241398.857247:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00010000:00010000:0.0:1782241399.557224:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241399.876820:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00010000:00010000:3.0:1782241400.582862:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241400.902598:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00000001:02000400:0.0:1782241401.282564:0:17332:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782241401.611705:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241401.925196:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00000100:00080000:3.0:1782241402.120799:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782241402.120808:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1782241402.120812:0:8:0:(import.c:65:import_set_state_nolock()) ffff890e7d549000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782241402.120821:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:3.0:1782241402.120827:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1782241402.120833:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff890e7d549000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241402.120857:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48137b80 x1868815140038144/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782241402.120872:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241402.120877:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782241402.120880:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241402.120883:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782241402.120893:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782241402.120896:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782241402.120898:0:8:0:(import.c:65:import_set_state_nolock()) ffff890d48035000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782241402.120903:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff890d48035000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241402.120916:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48134380 x1868815140038272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782241402.120936:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241402.120950:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140038016:0@lo:400:kworker.0 00000100:00100000:3.0:1782241402.121026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241402.121100:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140038016 00000100:00100000:3.0:1782241402.121108:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140038016 00000100:00100000:3.0:1782241402.121621:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782241402.121630:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4c44e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:3639:x1868815140038016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241402.121698:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4c44e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:3639:x1868815140038016:12345-0@lo:400:kworker.0 Request processed in 69us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241402.121706:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782241402.121745:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140038144:0@lo:38:kworker.0 00000100:00100000:3.0:1782241402.121796:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241402.121817:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1868815140038272:0@lo:38:kworker.0 00000100:00100000:3.0:1782241402.121841:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241402.121890:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140038016:0@lo:400:kworker.0 00000100:00100000:1.0:1782241402.122013:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140038272 00000100:00100000:1.0:1782241402.122019:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140038272 00000100:00100000:1.0:1782241402.122041:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241402.122047:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1868815140038272:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1782241402.122068:0:17049:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:1.0:1782241402.122105:0:17049:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc9959f2fb1e1a8d6 00000004:00100000:1.0:1782241402.122133:0:17049:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782241402.122265:0:17049:0:(import.c:65:import_set_state_nolock()) ffff890e48dc1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241402.122306:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1868815140038272:12345-0@lo:38:kworker.0 Request processed in 258us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241402.122313:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782241402.122930:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff890d48134380 x1868815140038272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782241402.122944:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1782241402.122959:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1782241402.122964:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782241402.122967:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d48035000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782241402.122973:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1868815140038272:0@lo:38:kworker.0 00000100:00100000:3.0:1782241402.128989:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140038144 00000100:00100000:3.0:1782241402.129014:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140038144 00000100:00100000:3.0:1782241402.129085:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782241402.129095:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1868815140038144:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1782241402.129118:0:17053:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1782241402.166166:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1868815140038144:12345-0@lo:38:kworker.0 Request processed in 37067us (44363us total) trans 0 rc -19/-19 00000100:00100000:2.0:1782241402.166180:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1782241402.169743:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7d549000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782241402.169943:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782241402.169949:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140038144:0@lo:38:kworker.0 00000020:00000004:0.0:1782241402.260658:0:17384:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782241402.261085:0:17384:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782241402.632277:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241402.948964:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00000020:00000004:2.0:1782241403.177578:0:17434:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782241403.178251:0:17434:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782241403.653993:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241403.973900:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00010000:00010000:3.0:1782241404.683165:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241404.996884:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00010000:00010000:0.0:1782241405.701606:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241406.021044:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00000100:00100000:3.0:1782241406.215024:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241396/real 1782241396] req@ffff890d48137480 x1868815140034944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241406 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241406.215054:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890d48137480 x1868815140034944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241406 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241406.215065:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241396/real 1782241396] req@ffff890d45a4a680 x1868815140034816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241406 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241406.215089:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890d45a4a680 x1868815140034816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241406 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782241406.215109:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e67fa6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782241406.215319:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782241406.215332:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140034944:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1782241406.215339:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e77aae000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782241406.218356:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1782241406.218363:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1782241406.218367:0:8:0:(import.c:65:import_set_state_nolock()) ffff890e7d549000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782241406.218375:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:1.0:1782241406.218381:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1782241406.218387:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff890e7d549000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241406.218410:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a49c00 x1868815140038528/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241406.218424:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782241406.218427:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1782241406.218429:0:8:0:(import.c:65:import_set_state_nolock()) ffff890e77aae000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782241406.218440:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:1.0:1782241406.218442:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1782241406.218447:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff890e77aae000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241406.218460:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a4b480 x1868815140038656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241406.218469:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782241406.218471:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782241406.218473:0:8:0:(import.c:65:import_set_state_nolock()) ffff890e67fa6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782241406.218476:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:1.0:1782241406.218478:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1782241406.218481:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff890e67fa6000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241406.218491:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a4b800 x1868815140038784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782241406.218534:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815140038912:0@lo:400:kworker.0 00000100:00100000:1.0:1782241406.218654:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241406.218716:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782241406.218723:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140038400:0@lo:400:kworker.0 00000100:00100000:1.0:1782241406.218753:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241406.218806:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140038912 00000100:00100000:1.0:1782241406.218813:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140038912 00000100:00100000:1.0:1782241406.218856:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241406.218865:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815140038912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241406.218920:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1868815140038912:12345-0@lo:400:kworker.0 Request processed in 55us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241406.218926:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241406.218958:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140038400 00000100:00100000:1.0:1782241406.218961:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140038400 00000100:00100000:1.0:1782241406.218986:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782241406.218992:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4c44e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:3638:x1868815140038400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241406.219023:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4c44e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:3638:x1868815140038400:12345-0@lo:400:kworker.0 Request processed in 31us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241406.219029:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782241406.219089:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140038400:0@lo:400:kworker.0 00010000:00080000:1.0:1782241406.219103:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff890d45a4bb80 x1868815140038912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241406.219112:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1868815140038912:0@lo:400:kworker.0 00000100:00080000:3.0:1782241406.222429:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782241406.222441:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140034816:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1782241406.222488:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140038528:0@lo:38:kworker.0 00000100:00100000:3.0:1782241406.222608:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241406.222649:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140038656:0@lo:8:kworker.0 00000400:00000100:3.0:1782241406.222672:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140038656 offset 0 length 520: 4 00000100:00100000:3.0:1782241406.222687:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140038784:0@lo:8:kworker.0 00000400:00000100:3.0:1782241406.222705:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140038784 offset 0 length 520: 4 00000100:00100000:2.0:1782241406.222790:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140038528 00000100:00100000:2.0:1782241406.222798:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140038528 00000100:00100000:2.0:1782241406.222842:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782241406.222849:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140038528:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1782241406.222869:0:17052:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1782241406.237025:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140038528:12345-0@lo:38:kworker.0 Request processed in 14166us (14407us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782241406.237040:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1782241406.237619:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7d549000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782241406.237627:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782241406.237631:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140038528:0@lo:38:kworker.0 00010000:00010000:2.0:1782241406.726359:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241407.053155:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00010000:00010000:0.0:1782241407.749024:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241408.068938:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00000040:00080000:3.0:1782241408.071261:0:17085:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782241408.773292:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241409.092866:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00000020:01000004:3.0:1782241409.764241:0:17779:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782241409.764247:0:17779:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1782241409.764249:0:17779:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1782241409.764420:0:17779:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff890d48032000 00000020:01000004:3.0:1782241409.764440:0:17779:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1782241409.764456:0:17779:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1782241409.764475:0:17779:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff890e77d999c0) 00000020:00000080:3.0:1782241409.764505:0:17779:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1782241409.798277:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1782241409.888577:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1782241409.891441:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1782241409.893870:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1782241409.894084:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1782241409.894352:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1782241409.894573:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1782241409.894902:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1782241409.896339:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1782241409.896749:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1782241409.897046:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1782241409.897373:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1782241409.897778:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1782241409.897990:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1782241409.898269:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1782241409.898580:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1782241409.899045:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1782241409.900040:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1782241409.900616:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1782241409.901127:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1782241409.901356:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1782241409.901578:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1782241409.901850:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1782241409.902053:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1782241409.902461:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1782241409.902720:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1782241409.903016:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1782241409.903226:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1782241409.903645:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1782241409.903937:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1782241409.906596:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1782241409.907416:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1782241409.908107:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1782241409.908613:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1782241409.908903:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1782241409.910110:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1782241409.910385:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1782241409.910926:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1782241409.911132:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1782241409.911592:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1782241409.912727:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1782241409.913413:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1782241409.913732:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1782241409.914070:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1782241409.914380:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1782241409.914618:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1782241409.914864:0:17779:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00080000:01000000:0.0:1782241409.916978:0:17779:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1782241409.917249:0:17779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1782241409.917262:0:17779:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1782241409.917276:0:17779:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e1a8e4 00000020:01000004:0.0:1782241409.917285:0:17779:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1782241409.917312:0:17779:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.158@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1782241409.917317:0:17779:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1782241409.917324:0:17779:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1782241409.917360:0:17779:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1782241409.917365:0:17779:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.158@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1782241409.925617:0:17779:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.158@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782241409.925721:0:17779:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.158@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1782241409.925726:0:17779:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782241409.925728:0:17779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1782241409.925729:0:17779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782241409.925731:0:17779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782241409.925732:0:17779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782241409.925733:0:17779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782241409.925735:0:17779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782241409.925737:0:17779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782241409.925738:0:17779:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782241409.925742:0:17779:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1782241409.925744:0:17779:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782241409.925932:0:17779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1782241409.925934:0:17779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782241409.925935:0:17779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782241409.925936:0:17779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782241409.925938:0:17779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782241409.925939:0:17779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782241409.925956:0:17779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782241409.925957:0:17779:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782241409.925988:0:17779:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1782241409.926010:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f32680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140039040:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782241409.926087:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241409.926149:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43b9c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241409.926202:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140039040 00000100:00100000:3.0:1782241409.926219:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140039040 00000100:00100000:3.0:1782241409.926448:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782241409.926461:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17779:x1868815140039040:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782241409.926530:0:17041:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1782241409.926534:0:17041:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1782241409.926545:0:17041:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1782241409.927056:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17779:x1868815140039040:12345-0@lo:253:mount.lustre.0 Request processed in 597us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241409.927067:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782241409.927158:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f32680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140039040:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1782241409.927174:0:17779:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1782241409.927177:0:17779:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782241409.927179:0:17779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1782241409.927181:0:17779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782241409.927182:0:17779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782241409.927184:0:17779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782241409.927185:0:17779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782241409.927186:0:17779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782241409.927189:0:17779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782241409.927190:0:17779:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782241409.927215:0:17779:0:(tgt_mount.c:101:server_register_mount()) register mount ffff890d48032000 from lustre-MDT0001 10000000:01000000:0.0:1782241409.927256:0:17779:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1782241409.927259:0:17779:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1782241409.927268:0:17779:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff890d4691cd40 local copy 00010000:00010000:0.0:1782241409.927352:0:17779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7e1 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241409.927543:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f32680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140039168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241409.927583:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241409.927732:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43b9c840 going to sleep for 11 seconds 00000100:00100000:3.0:1782241409.927982:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140039168 00000100:00100000:3.0:1782241409.927999:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140039168 00000100:00100000:3.0:1782241409.930779:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782241409.930815:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17779:x1868815140039168:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241409.931046:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17779:x1868815140039168:12345-0@lo:501:mount.lustre.0 Request processed in 249us (3461us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782241409.931059:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782241409.931187:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f32680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140039168:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1782241409.931224:0:17779:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782241409.931278:0:17779:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782241409.931289:0:17779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7e1 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241409.931300:0:17779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7e1 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241409.931337:0:17779:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff890d48032000 10000000:01000000:1.0:1782241409.931344:0:17779:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782241409.931350:0:17779:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff890d4691cd40 10000000:01000000:1.0:1782241409.931352:0:17779:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1782241409.931355:0:17779:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff890d4691cd40 from 1 10000000:01000000:1.0:1782241409.931358:0:17779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782241409.931425:0:17779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1a8eb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241409.931434:0:17779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1a8eb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241409.931445:0:17779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1a8eb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241409.931467:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140039296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782241409.931567:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241409.931617:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a28180 going to sleep for 11 seconds 00000100:00100000:2.0:1782241409.931650:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140039296 00000100:00100000:2.0:1782241409.931669:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140039296 00000100:00100000:2.0:1782241409.931731:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782241409.931741:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+12:17779:x1868815140039296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782241409.931753:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241409.931795:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b861e00/0xc9959f2fb1e1a8f2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1a8eb expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241409.931825:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b861e00/0xc9959f2fb1e1a8f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a8eb expref: 13 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241409.931839:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b861e00/0xc9959f2fb1e1a8f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a8eb expref: 13 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241409.931851:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861e00, rc 0) 00000100:00100000:2.0:1782241409.931905:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+13:17779:x1868815140039296:12345-0@lo:101:mount.lustre.0 Request processed in 167us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241409.931913:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782241409.932068:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140039296:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241409.932089:0:17779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1a8eb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a8f2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241409.932100:0:17779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1a8eb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a8f2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241409.932178:0:17779:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782241409.932195:0:17779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1a8eb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a8f2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241409.932203:0:17779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e779eac00/0xc9959f2fb1e1a8eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a8f2 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241409.932212:0:17779:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff890d48032000 10000000:01000000:1.0:1782241409.932218:0:17779:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1782241409.932222:0:17779:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff890d48032000 from 1 10000000:01000000:1.0:1782241409.932232:0:17779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1782241409.932253:0:17779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241409.932261:0:17779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241409.932270:0:17779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241409.932283:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140039424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782241409.932316:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241409.932345:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a28180 going to sleep for 11 seconds 00000100:00100000:0.0:1782241409.932375:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140039424 00000100:00100000:0.0:1782241409.932382:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140039424 00000100:00100000:0.0:1782241409.932439:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782241409.932447:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+13:17779:x1868815140039424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241409.932458:0:17042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241409.932481:0:17042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e778f1c00/0xc9959f2fb1e1a900 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1a8f9 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241409.932511:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e778f1c00/0xc9959f2fb1e1a900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a8f9 expref: 14 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241409.932520:0:17042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e778f1c00/0xc9959f2fb1e1a900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a8f9 expref: 14 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241409.932527:0:17042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1c00, rc 0) 00000100:00100000:0.0:1782241409.932572:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+14:17779:x1868815140039424:12345-0@lo:101:mount.lustre.0 Request processed in 126us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241409.932579:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782241409.933634:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140039424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241409.933655:0:17779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a900 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241409.933666:0:17779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a900 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241409.933684:0:17779:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1782241409.934201:0:17779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a900 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241409.934212:0:17779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e779eae00/0xc9959f2fb1e1a8f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a900 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241409.934221:0:17779:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1782241409.934230:0:17779:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782241409.934249:0:17779:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff890d48032000 10000000:01000000:1.0:1782241409.934253:0:17779:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1782241409.934257:0:17779:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1782241409.934259:0:17779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1782241409.934293:0:17779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241409.934302:0:17779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241409.934311:0:17779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241409.934329:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140039552:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782241409.934393:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241409.934431:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a28180 going to sleep for 11 seconds 00000100:00100000:3.0:1782241409.934519:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140039552 00000100:00100000:3.0:1782241409.934531:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140039552 00000100:00100000:3.0:1782241409.934783:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782241409.934795:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+14:17779:x1868815140039552:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241409.934812:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241409.934830:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164ca00/0xc9959f2fb1e1a90e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1a907 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241409.934859:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164ca00/0xc9959f2fb1e1a90e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a907 expref: 15 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241409.934871:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164ca00/0xc9959f2fb1e1a90e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a907 expref: 15 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241409.934882:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164ca00, rc 0) 00000100:00100000:3.0:1782241409.934962:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+15:17779:x1868815140039552:12345-0@lo:101:mount.lustre.0 Request processed in 169us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241409.934970:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782241409.935084:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140039552:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241409.935103:0:17779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a90e expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241409.935114:0:17779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a90e expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782241409.937935:0:17779:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1782241409.941184:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782241409.949959:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1782241409.950022:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1782241409.950039:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1782241409.950053:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1782241409.950067:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1782241409.950089:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1782241409.950101:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1782241409.950112:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1782241409.950199:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1782241409.950213:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1782241409.950224:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1782241409.950235:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1782241409.950247:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1782241409.950261:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1782241409.950271:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1782241409.950281:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1782241409.950291:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1782241409.950301:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1782241409.950310:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1782241409.950320:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1782241409.950329:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1782241409.950339:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1782241409.950349:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1782241409.950439:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1782241409.950447:0:17779:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1782241409.950568:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140039680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241409.950800:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241409.950898:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a289c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241409.950954:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140039680 00000100:00100000:2.0:1782241409.950962:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140039680 00000100:00100000:2.0:1782241409.951029:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782241409.951038:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+15:17779:x1868815140039680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241409.951315:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+15:17779:x1868815140039680:12345-0@lo:501:mount.lustre.0 Request processed in 278us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241409.951323:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782241409.951446:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140039680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241409.951496:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140039808:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782241409.951539:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241409.951559:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a289c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241409.951944:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140039808 00000100:00100000:3.0:1782241409.951962:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140039808 00000100:00100000:3.0:1782241409.952031:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782241409.952043:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+15:17779:x1868815140039808:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241409.954654:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+15:17779:x1868815140039808:12345-0@lo:503:mount.lustre.0 Request processed in 2601us (3101us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241409.955058:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140039808:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241409.955547:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000040:00080000:1.0:1782241409.958530:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782241409.959205:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140039936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782241409.959338:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241409.959392:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a28180 going to sleep for 11 seconds 00000100:00100000:2.0:1782241409.959526:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140039936 00000100:00100000:2.0:1782241409.959544:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140039936 00000100:00100000:2.0:1782241409.959627:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782241409.959650:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+15:17779:x1868815140039936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241409.962705:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+15:17779:x1868815140039936:12345-0@lo:502:mount.lustre.0 Request processed in 3047us (3358us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241409.962721:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782241409.963009:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140039936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782241409.963291:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1782241409.963332:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1782241409.963346:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1782241409.963360:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1782241409.963373:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1782241409.963400:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1782241409.963413:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1782241409.963426:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1782241409.963438:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1782241409.963453:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1782241409.963466:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1782241409.963479:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1782241409.963502:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1782241409.963516:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1782241409.963528:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1782241409.963539:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1782241409.963552:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1782241409.963564:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1782241409.963582:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1782241409.963597:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1782241409.963618:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1782241409.963641:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1782241409.963662:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1782241409.963692:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1782241409.963705:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1782241409.963717:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1782241409.963730:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1782241409.963754:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1782241409.963818:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1782241409.963832:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1782241409.963849:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1782241409.963860:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1782241409.963870:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1782241409.963882:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1782241409.963893:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1782241409.963904:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1782241409.963931:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1782241409.963944:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1782241409.963956:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1782241409.963967:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1782241409.963978:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1782241409.963990:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1782241409.964002:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1782241409.964015:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1782241409.964057:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140040064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782241409.964126:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241409.964160:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a28180 going to sleep for 11 seconds 00000100:00100000:3.0:1782241409.965246:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140040064 00000100:00100000:3.0:1782241409.965264:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140040064 00000100:00100000:3.0:1782241409.965376:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782241409.965389:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+15:17779:x1868815140040064:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241409.965636:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+15:17779:x1868815140040064:12345-0@lo:502:mount.lustre.0 Request processed in 249us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241409.965645:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782241409.966030:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140040064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782241409.966162:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1782241409.966181:0:17779:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1782241409.968458:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241409.968476:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241409.968478:0:17783:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1782241409.968495:0:17783:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1782241409.968498:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782241409.968515:0:17783:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff890e81fc8000) 00000020:00000080:2.0:1782241409.968540:0:17783:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1782241409.968546:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1782241409.968645:0:17783:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782241409.968654:0:17783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e1a91c 00000020:00000080:2.0:1782241409.968973:0:17783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1782241409.968979:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241409.968983:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241409.968985:0:17783:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1782241409.968988:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241409.968992:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241409.968993:0:17783:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1782241409.969004:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782241409.969011:0:17783:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff890e81fcb380) 00000020:00000080:2.0:1782241409.969021:0:17783:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1782241409.969025:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1782241409.969027:0:17783:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1782241409.969030:0:17783:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1782241409.969036:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782241409.969081:0:17783:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890d48032000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1782241409.969092:0:17783:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff890e81fc99c0) 00000020:00000080:2.0:1782241409.969100:0:17783:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1782241409.969173:0:17783:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1782241409.969179:0:17783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e1a931 00000020:00000080:2.0:1782241409.969265:0:17783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1782241409.969273:0:17783:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1782241409.969277:0:17783:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc9959f2fb1e1a938 00080000:01000000:2.0:1782241409.969282:0:17783:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1782241409.969286:0:17783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e1a93f 00010000:00010000:2.0:1782241410.048456:0:17783:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1782241410.049793:0:17783:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1782241410.050143:0:17783:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1782241410.051068:0:17783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1782241410.051080:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241410.051085:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241410.051088:0:17783:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1782241410.051090:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241410.051096:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241410.051097:0:17783:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1782241410.051100:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782241410.051106:0:17783:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:00000080:2.0:1782241410.051131:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782241410.051146:0:17783:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff890e81fccd40) 00000020:00000080:2.0:1782241410.051168:0:17783:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1782241410.051177:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782241410.051234:0:17783:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1782241410.051240:0:17783:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1782241410.051249:0:17783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e1a94d 00010000:00080000:2.0:1782241410.051278:0:17783:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890e42fa4000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241410.053006:0:17783:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1782241410.059264:0:17783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1782241410.059282:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1782241410.059321:0:17783:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1782241410.059748:0:17783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e1a954 00000100:00080000:2.0:1782241410.059785:0:17783:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782241410.059793:0:17783:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff890e42fa4000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241410.059840:0:17783:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e47ae8000 x1868815140040192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782241410.059864:0:17783:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1782241410.059921:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241410.059925:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241410.059927:0:17783:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1782241410.059930:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1782241410.059933:0:17783:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1782241410.059935:0:17783:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782241410.059936:0:17783:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782241410.059938:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1782241410.059940:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241410.059941:0:17783:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1782241410.059944:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782241410.059948:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241410.059949:0:17783:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1782241410.059953:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1782241410.059983:0:17783:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1782241410.059995:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782241410.059997:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241410.060003:0:17783:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1782241410.060006:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1782241410.060007:0:17783:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1782241410.060009:0:17783:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782241410.060010:0:17783:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782241410.060012:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1782241410.060014:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241410.060015:0:17783:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1782241410.060017:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782241410.060020:0:17783:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1782241410.060023:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241410.060024:0:17783:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1782241410.060027:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782241410.060031:0:17783:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:01000000:2.0:1782241410.060054:0:17783:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1782241410.060056:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782241410.060068:0:17783:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff890e43fe99c0) 00000020:00000080:2.0:1782241410.060080:0:17783:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1782241410.060083:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782241410.060134:0:17783:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1782241410.060140:0:17783:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1782241410.060145:0:17783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e1a962 00010000:00080000:2.0:1782241410.060172:0:17783:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890e7c69c800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.158@tcp at head 00000100:00100000:3.0:1782241410.060869:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140040192:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782241410.060951:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782241410.061034:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782241410.061039:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1782241410.061041:0:468:0:(import.c:65:import_set_state_nolock()) ffff890e7d549000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782241410.061045:0:468:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:3.0:1782241410.061048:0:468:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1782241410.061052:0:468:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff890e7d549000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241410.061072:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48134380 x1868815140040320/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782241410.061087:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241410.061090:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782241410.061093:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241410.061095:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782241410.061132:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140040448:0@lo:400:kworker.0 00000100:00100000:3.0:1782241410.061160:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241410.061193:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140040320:0@lo:38:kworker.0 00000100:00100000:3.0:1782241410.061212:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241410.061237:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140040192 00000100:00100000:3.0:1782241410.061245:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140040192 00000100:00100000:3.0:1782241410.061265:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140040320 00000100:00100000:3.0:1782241410.061267:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140040320 00000100:00100000:3.0:1782241410.061278:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782241410.061285:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140040192:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1782241410.061311:0:17052:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000100:00100000:1.0:1782241410.061449:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140040448 00000100:00100000:1.0:1782241410.061454:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140040448 00000100:00100000:1.0:1782241410.061494:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241410.061500:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140040448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241410.061553:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140040448:12345-0@lo:400:kworker.0 Request processed in 53us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241410.061560:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782241410.061603:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff890d48135180 x1868815140040448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241410.061831:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140040448:0@lo:400:kworker.0 00010000:00010000:2.0:1782241410.062513:0:17783:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000020:00000080:3.0:1782241410.062803:0:17052:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e1a969 00000004:00100000:3.0:1782241410.062820:0:17052:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1782241410.062826:0:17052:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:2.0:1782241410.064515:0:17783:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1782241410.066264:0:17783:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1782241410.069323:0:17783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782241410.069791:0:17783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1782241410.069930:0:17783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1782241410.070238:0:17788:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1782241410.070242:0:17788:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1782241410.070936:0:17783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782241410.070947:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782241410.070986:0:17783:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1782241410.071005:0:17783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e1a970 00000100:00080000:0.0:1782241410.071015:0:17783:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782241410.071020:0:17783:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff890e7c69c800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241410.071050:0:17783:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e43f32300 x1868815140040576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241410.071085:0:17783:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1782241410.071136:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241410.071140:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241410.071142:0:17783:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1782241410.071145:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1782241410.071148:0:17783:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1782241410.071149:0:17783:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782241410.071151:0:17783:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782241410.071153:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1782241410.071155:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241410.071156:0:17783:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1782241410.071158:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782241410.071162:0:17783:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1782241410.071166:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241410.071167:0:17783:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1782241410.071169:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782241410.071173:0:17783:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.158@tcp to nid 0x20000c0a8cc9e (192.168.204.158@tcp) 00000020:01000000:0.0:1782241410.071196:0:17783:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1782241410.071198:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782241410.071209:0:17783:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff890d46740000) 00000020:00000080:0.0:1782241410.071220:0:17783:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1782241410.071224:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782241410.071277:0:17783:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1782241410.071282:0:17783:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1782241410.071287:0:17783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc9959f2fb1e1a97e 00010000:00080000:0.0:1782241410.071313:0:17783:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d469bc000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.158@tcp at head 00000100:00100000:1.0:1782241410.071501:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140040576:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1782241410.071558:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140040576 offset 0 length 520: 4 00010000:00010000:0.0:1782241410.071848:0:17783:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1782241410.071909:0:17783:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1782241410.071922:0:17783:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1782241410.072492:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241410.072498:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782241410.072501:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241410.072503:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1782241410.074306:0:17783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782241410.074735:0:17783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000100:00080000:2.0:1782241410.075102:0:17052:0:(import.c:65:import_set_state_nolock()) ffff890e7c698800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241410.075195:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1868815140040192:12345-0@lo:38:llog_process_th.0 Request processed in 13906us (14241us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241410.075205:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782241410.075234:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782241410.075240:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140040320:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1782241410.075294:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140040320:12345-0@lo:38:kworker.0 Request processed in 53us (14080us total) trans 0 rc -11/-11 00000100:00100000:2.0:1782241410.075301:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782241410.075441:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782241410.075450:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7d549000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782241410.075454:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1782241410.075457:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140040320:0@lo:38:kworker.0 00000100:00100000:3.0:1782241410.075470:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782241410.075476:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1782241410.075499:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1782241410.075504:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782241410.075507:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e42fa4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782241410.075518:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140040192:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782241410.075685:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140040704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241410.075718:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241410.075860:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140040704 00000100:00100000:0.0:1782241410.075866:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140040704 00000100:00100000:0.0:1782241410.075905:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782241410.075912:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1868815140040704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241410.075935:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1782241410.075970:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1868815140040704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241410.075976:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782241410.076104:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140040704:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1782241410.078229:0:17783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1782241410.079030:0:17790:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1782241410.079035:0:17790:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1782241410.080152:0:17783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1782241410.080167:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782241410.080204:0:17783:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1782241410.080225:0:17783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e1a985 00000100:00080000:1.0:1782241410.080236:0:17783:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782241410.080242:0:17783:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff890d469bc000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241410.080275:0:17783:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a48e00 x1868815140040832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782241410.080344:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140040832:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1782241410.080399:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140040832 offset 0 length 520: 4 00000100:00080000:1.0:1782241410.080519:0:17783:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1782241410.080637:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241410.080641:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241410.080643:0:17783:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1782241410.080646:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241410.080650:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241410.080651:0:17783:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782241410.080654:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782241410.080656:0:17783:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782241410.080658:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241410.080667:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241410.080668:0:17783:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782241410.080671:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241410.080674:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241410.080675:0:17783:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782241410.080688:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1782241410.080717:0:17783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241410.080719:0:17783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241410.080720:0:17783:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782241410.080722:0:17783:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1782241410.080805:0:17779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1782241410.080838:0:17779:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1782241410.080855:0:17779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a90e expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.080866:0:17779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e779eb400/0xc9959f2fb1e1a907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a90e expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241410.080875:0:17779:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d48032000 from 1 10000000:01000000:1.0:1782241410.080878:0:17779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782241410.080904:0:17779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1a98c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.080912:0:17779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1a98c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.080924:0:17779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1a98c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241410.080938:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140040960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782241410.080976:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241410.080994:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a28e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241410.081016:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140040960 00000100:00100000:1.0:1782241410.081022:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140040960 00000100:00100000:1.0:1782241410.081057:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782241410.081064:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+15:17779:x1868815140040960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241410.081083:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241410.081094:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a993 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1a98c expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.081116:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a98c expref: 16 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.081125:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a98c expref: 16 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.081134:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eba00, rc 0) 00000100:00100000:1.0:1782241410.081167:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+16:17779:x1868815140040960:12345-0@lo:101:mount.lustre.0 Request processed in 102us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241410.081173:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782241410.081216:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140040960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241410.081229:0:17779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1a98c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a993 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.081238:0:17779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1a98c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a993 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241410.082057:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140041088:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1782241410.082092:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241410.082112:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a28e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241410.082253:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140041088 00000100:00100000:3.0:1782241410.082259:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140041088 00000100:00100000:3.0:1782241410.082294:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782241410.082301:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+16:17779:x1868815140041088:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1782241410.082319:0:17039:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1782241410.082407:0:17039:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782241410.082411:0:17039:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1782241410.082502:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+16:17779:x1868815140041088:12345-0@lo:256:mount.lustre.0 Request processed in 201us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241410.082509:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1782241410.082732:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241410.082738:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241410.082741:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241410.082744:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782241410.082957:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140041088:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1782241410.084211:0:17779:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782241410.084269:0:17779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1a98c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a993 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.084290:0:17779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1a98c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a993 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241410.084299:0:17779:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890d48032000 from 1 10000000:01000000:1.0:1782241410.084301:0:17779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782241410.084338:0:17779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779ea600/0xc9959f2fb1e1a99a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.084346:0:17779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e779ea600/0xc9959f2fb1e1a99a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.084356:0:17779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e779ea600/0xc9959f2fb1e1a99a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241410.084375:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140041216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782241410.084419:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241410.084453:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a28e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241410.084562:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140041216 00000100:00100000:3.0:1782241410.084569:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140041216 00000100:00100000:3.0:1782241410.084620:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782241410.084628:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+16:17779:x1868815140041216:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241410.084640:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241410.084650:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e1a9a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1a99a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241410.084686:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e1a9a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a99a expref: 17 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241410.084696:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e1a9a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a99a expref: 17 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241410.084705:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c800, rc 0) 00000100:00100000:3.0:1782241410.084746:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17779:x1868815140041216:12345-0@lo:101:mount.lustre.0 Request processed in 119us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241410.084752:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782241410.084990:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140041216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241410.085004:0:17779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e779ea600/0xc9959f2fb1e1a99a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a9a1 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241410.085013:0:17779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e779ea600/0xc9959f2fb1e1a99a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a9a1 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782241410.085151:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782241410.085177:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140041344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241410.085202:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241410.085231:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43b9ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241410.085294:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140041344 00000100:00100000:1.0:1782241410.085298:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140041344 00000100:00100000:1.0:1782241410.085322:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782241410.085398:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17779:x1868815140041344:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241410.085478:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17779:x1868815140041344:12345-0@lo:501:mount.lustre.0 Request processed in 83us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241410.085520:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782241410.085589:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140041344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241410.085625:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140041472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782241410.085676:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241410.085692:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43b9ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1782241410.085794:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140041472 00000100:00100000:1.0:1782241410.085798:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140041472 00000100:00100000:1.0:1782241410.085826:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782241410.085832:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17779:x1868815140041472:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782241410.085905:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17779:x1868815140041472:12345-0@lo:503:mount.lustre.0 Request processed in 73us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241410.085911:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782241410.086217:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140041472:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782241410.086574:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782241410.086656:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140041600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241410.086700:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241410.086728:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43b9cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241410.087001:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140041600 00000100:00100000:1.0:1782241410.087006:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140041600 00000100:00100000:1.0:1782241410.087039:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782241410.087045:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e50599c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17779:x1868815140041600:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782241410.087114:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e50599c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17779:x1868815140041600:12345-0@lo:502:mount.lustre.0 Request processed in 69us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241410.087121:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782241410.087242:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140041600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782241410.087514:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1782241410.087539:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1782241410.087553:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1782241410.087567:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1782241410.087578:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1782241410.087590:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1782241410.087601:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1782241410.087629:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1782241410.087641:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1782241410.087653:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1782241410.087727:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1782241410.087750:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140041728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241410.087923:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241410.087979:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43b9cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241410.088454:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140041728 00000100:00100000:1.0:1782241410.088460:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140041728 00000100:00100000:1.0:1782241410.088538:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782241410.088547:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5059ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17779:x1868815140041728:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782241410.088815:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5059ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17779:x1868815140041728:12345-0@lo:502:mount.lustre.0 Request processed in 209us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241410.088823:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782241410.088900:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140041728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782241410.088954:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1782241410.088963:0:17779:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1782241410.089372:0:17792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241410.089382:0:17792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241410.089384:0:17792:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782241410.089392:0:17792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890d48032000 00000020:00000080:3.0:1782241410.089394:0:17792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782241410.089402:0:17792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241410.089405:0:17792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241410.089406:0:17792:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1782241410.089409:0:17792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241410.089411:0:17792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241410.089413:0:17792:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782241410.089416:0:17792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890d48032000 00000020:00000080:3.0:1782241410.089418:0:17792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782241410.089476:0:17792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241410.089479:0:17792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241410.089491:0:17792:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1782241410.089494:0:17792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241410.089497:0:17792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241410.089498:0:17792:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782241410.089501:0:17792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890d48032000 00000020:00000080:3.0:1782241410.089509:0:17792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782241410.089529:0:17792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241410.089533:0:17792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241410.089534:0:17792:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782241410.089536:0:17792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241410.089539:0:17792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241410.089540:0:17792:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1782241410.089543:0:17792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890d48032000 00000020:00000080:3.0:1782241410.089545:0:17792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782241410.089575:0:17792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241410.089579:0:17792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241410.089580:0:17792:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1782241410.089583:0:17792:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1782241410.089637:0:17779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1782241410.089659:0:17779:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782241410.089684:0:17779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779ea600/0xc9959f2fb1e1a99a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a9a1 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241410.089695:0:17779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e779ea600/0xc9959f2fb1e1a99a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a9a1 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241410.089739:0:17779:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782241410.089742:0:17779:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff890d48032000 10000000:01000000:3.0:1782241410.089745:0:17779:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff890d48032000 10000000:01000000:3.0:1782241410.089749:0:17779:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782241410.089773:0:17779:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890d48032000 from 1 10000000:01000000:3.0:1782241410.089777:0:17779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782241410.089806:0:17779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241410.089813:0:17779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241410.089832:0:17779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241410.089848:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140041856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782241410.089883:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241410.094493:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241410.094574:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140041856 00000100:00100000:2.0:1782241410.094584:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140041856 00000100:00100000:2.0:1782241410.094647:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782241410.094657:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5059a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17779:x1868815140041856:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782241410.094686:0:17042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241410.094707:0:17042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e1a9af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1a9a8 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.094738:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e1a9af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a9a8 expref: 18 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.094750:0:17042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b861000/0xc9959f2fb1e1a9af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a9a8 expref: 18 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.094773:0:17042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861000, rc 0) 00000100:00100000:2.0:1782241410.094830:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5059a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17779:x1868815140041856:12345-0@lo:101:mount.lustre.0 Request processed in 175us (4946us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241410.094838:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782241410.101081:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140041856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241410.101112:0:17779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a9af expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241410.101126:0:17779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a9af expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782241410.103720:0:17779:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1782241410.104004:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782241410.104180:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1782241410.104205:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1782241410.104219:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1782241410.104232:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1782241410.104245:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1782241410.104256:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1782241410.104267:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1782241410.104280:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1782241410.104292:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1782241410.104304:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1782241410.104315:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1782241410.104890:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1782241410.104913:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1782241410.104925:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1782241410.104954:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1782241410.104967:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1782241410.104978:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1782241410.104990:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1782241410.105002:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1782241410.105013:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1782241410.105025:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1782241410.105036:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1782241410.105047:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1782241410.105059:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1782241410.105070:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1782241410.105082:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1782241410.105093:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1782241410.105104:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1782241410.105122:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1782241410.105126:0:17779:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1782241410.105215:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140041984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241410.105281:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241410.105318:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d600 going to sleep for 11 seconds 00000100:00100000:2.0:1782241410.105408:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140041984 00000100:00100000:2.0:1782241410.105414:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140041984 00000100:00100000:2.0:1782241410.105460:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782241410.105468:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5059a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17779:x1868815140041984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241410.105598:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5059a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17779:x1868815140041984:12345-0@lo:501:mount.lustre.0 Request processed in 130us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241410.105624:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782241410.107805:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140041984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241410.107856:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140042112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241410.107912:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241410.107949:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d600 going to sleep for 11 seconds 00000100:00100000:2.0:1782241410.108114:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140042112 00000100:00100000:2.0:1782241410.108120:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140042112 00000100:00100000:2.0:1782241410.108167:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782241410.108175:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5059b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17779:x1868815140042112:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782241410.108288:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5059b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17779:x1868815140042112:12345-0@lo:503:mount.lustre.0 Request processed in 112us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241410.108295:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782241410.108438:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140042112:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782241410.108999:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782241410.109073:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140042240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241410.109110:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241410.109142:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241410.109257:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140042240 00000100:00100000:1.0:1782241410.109263:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140042240 00000100:00100000:1.0:1782241410.109297:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782241410.109304:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5059b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17779:x1868815140042240:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782241410.109500:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5059b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17779:x1868815140042240:12345-0@lo:502:mount.lustre.0 Request processed in 195us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241410.109507:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782241410.110478:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140042240:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241410.110855:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1782241410.110884:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1782241410.110896:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1782241410.110908:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1782241410.110919:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1782241410.110930:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1782241410.110942:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1782241410.110953:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1782241410.110965:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1782241410.110976:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1782241410.110986:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1782241410.110998:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1782241410.111008:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1782241410.111020:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1782241410.111031:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1782241410.111055:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1782241410.111068:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1782241410.111079:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1782241410.111091:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1782241410.111102:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1782241410.111113:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1782241410.111125:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1782241410.111135:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1782241410.111147:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1782241410.111158:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1782241410.111169:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1782241410.111180:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1782241410.111192:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1782241410.111204:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1782241410.111215:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1782241410.111227:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1782241410.111258:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1782241410.111272:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1782241410.111284:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1782241410.111295:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1782241410.111306:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1782241410.111318:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1782241410.112842:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1782241410.112883:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1782241410.112896:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1782241410.112908:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1782241410.112920:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1782241410.112932:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1782241410.112943:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1782241410.112954:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1782241410.112965:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1782241410.112977:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1782241410.113003:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1782241410.113053:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140042368:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241410.113119:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241410.114529:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241410.117734:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00000100:00100000:2.0:1782241410.122361:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140042368 00000100:00100000:2.0:1782241410.122375:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140042368 00000100:00100000:2.0:1782241410.122432:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782241410.122442:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e50598850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17779:x1868815140042368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241410.124795:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e50598850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17779:x1868815140042368:12345-0@lo:502:mount.lustre.0 Request processed in 2345us (11666us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241410.124811:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782241410.127543:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140042368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241410.127985:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1782241410.128015:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1782241410.128055:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140042496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241410.128125:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241410.128172:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140042496 00000100:00100000:3.0:1782241410.128178:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140042496 00000100:00100000:3.0:1782241410.128274:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782241410.128284:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e50599050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17779:x1868815140042496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241410.128844:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e50599050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17779:x1868815140042496:12345-0@lo:502:mount.lustre.0 Request processed in 559us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241410.128853:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782241410.132598:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241410.132655:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140042496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782241410.132900:0:17779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1782241410.132917:0:17779:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1782241410.138900:0:17798:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1782241410.138918:0:17798:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff890e43feb380) 00000020:00000080:2.0:1782241410.138942:0:17798:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1782241410.140470:0:17798:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890d48032000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1782241410.140478:0:17798:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890d48032000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1782241410.140492:0:17798:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890d48032000 3 00010000:00080000:2.0:1782241410.140524:0:17798:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d480ce000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.158@tcp at head 00010000:00010000:2.0:1782241410.144964:0:17798:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1782241410.145068:0:17798:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1782241410.145109:0:17798:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782241410.145120:0:17798:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc9959f2fb1e1a9bd 00000100:00080000:2.0:1782241410.145130:0:17798:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782241410.145136:0:17798:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff890d480ce000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:2.0:1782241410.145171:0:17798:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e47ae9c00 x1868815140042624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782241410.145202:0:17798:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782241410.145224:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241410.145228:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241410.145231:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241410.145234:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782241410.145521:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1868815140042624:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782241410.145594:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241410.145649:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140042624 00000100:00100000:1.0:1782241410.145654:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140042624 00000100:00100000:1.0:1782241410.145682:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782241410.145689:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1868815140042624:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782241410.145713:0:17049:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:1.0:1782241410.145740:0:17049:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc9959f2fb1e1a9c4 00000004:00100000:1.0:1782241410.145753:0:17049:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782241410.145806:0:17049:0:(import.c:65:import_set_state_nolock()) ffff890e67fe4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241410.145853:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1868815140042624:12345-0@lo:38:llog_process_th.0 Request processed in 162us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241410.145860:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782241410.145896:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff890e47ae9c00 x1868815140042624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241410.145905:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782241410.145912:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1782241410.145918:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1782241410.145923:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782241410.145925:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d480ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782241410.145930:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1868815140042624:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1782241410.146423:0:17798:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1782241410.149033:0:17779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1782241410.149078:0:17779:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782241410.149103:0:17779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a9af expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241410.149115:0:17779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164dc00/0xc9959f2fb1e1a9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a9af expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782241410.149175:0:17779:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782241410.149178:0:17779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782241410.149179:0:17779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241410.149180:0:17779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241410.149181:0:17779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241410.149183:0:17779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241410.149184:0:17779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241410.149185:0:17779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241410.149186:0:17779:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782241410.149190:0:17779:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1782241410.149192:0:17779:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782241410.149193:0:17779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782241410.149194:0:17779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241410.149195:0:17779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241410.149197:0:17779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241410.149197:0:17779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241410.149199:0:17779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241410.149200:0:17779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241410.149201:0:17779:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782241410.149227:0:17779:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1782241410.149246:0:17779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140042752:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782241410.149310:0:17779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241410.149355:0:17779:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d300 going to sleep for 11 seconds 00000100:00100000:2.0:1782241410.149442:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140042752 00000100:00100000:2.0:1782241410.149450:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140042752 00000100:00100000:2.0:1782241410.149508:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782241410.149518:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17779:x1868815140042752:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782241410.149560:0:17042:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1782241410.149574:0:17042:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1782241410.151621:0:17027:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1782241410.154505:0:17042:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782241410.154520:0:17042:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1782241410.154552:0:17063:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782241410.154557:0:17063:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782241410.154579:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1a9cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.154598:0:17063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1a8cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a8c8 expref: 18 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.154613:0:17063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a98c expref: 18 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.154622:0:17063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1a9cb lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241410.154887:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17779:x1868815140042752:12345-0@lo:253:mount.lustre.0 Request processed in 5368us (5574us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241410.154897:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:1.0:1782241410.155425:0:17063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1a98c expref: 17 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.155440:0:17063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a993 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a98c expref: 17 pid: 17041 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241410.155454:0:17063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1868815140042880:0@lo:104: 00000100:00100000:3.0:1782241410.155601:0:17779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17779:1868815140042752:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782241410.155617:0:17779:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1782241410.155620:0:17779:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782241410.155622:0:17779:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782241410.155623:0:17779:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241410.155624:0:17779:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241410.155625:0:17779:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241410.155627:0:17779:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241410.155628:0:17779:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782241410.155630:0:17779:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241410.155632:0:17779:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782241410.155651:0:17779:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1782241410.156441:0:17063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782241410.156509:0:17063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1a8cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1a8c8 expref: 17 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241410.156519:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140042880 00010000:00010000:1.0:1782241410.156519:0:17063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1a8cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a8c8 expref: 17 pid: 17039 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241410.156525:0:17030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140042880 00000100:00100000:1.0:1782241410.156529:0:17063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1868815140043008:0@lo:104: 00000100:00100000:1.0:1782241410.156553:0:17063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241410.156568:0:17063:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77a28000 going to sleep for 11 seconds 00000100:00100000:2.0:1782241410.156569:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140043008 00000100:00100000:2.0:1782241410.156572:0:17030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140043008 00000100:00100000:2.0:1782241410.156585:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241410.156592:0:17030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+4:17063:x1868815140042880:12345-0@lo:104: 00010000:00010000:2.0:1782241410.156678:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1a98c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1a993 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.156737:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782241410.156744:0:17030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+4:17063:x1868815140042880:12345-0@lo:104: Request processed in 152us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241410.156751:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241410.156788:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782241410.156795:0:17030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+3:17063:x1868815140043008:12345-0@lo:104: 00010000:00010000:2.0:1782241410.156803:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a8c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1a8cf expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.156834:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782241410.156839:0:17030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+3:17063:x1868815140043008:12345-0@lo:104: Request processed in 46us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241410.156845:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1782241410.156862:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782241410.156868:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1a98c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1a993 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.156875:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb000 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241410.156880:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1a98c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1a993 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.156887:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1a98c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1a993 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241410.156900:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1a98c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1a993 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241410.156905:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782241410.156931:0:17036:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1a98c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a993 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.156937:0:17036:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782241410.156954:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1a98c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a993 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.156960:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1a98c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a993 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.156971:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241410.156974:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a8c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1a8cf expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.156979:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861400 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:2.0:1782241410.156982:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a8c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1a8cf expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.156988:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a8c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1a8cf expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782241410.156993:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a8c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1a8cf expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241410.156998:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782241410.157013:0:17036:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a8c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a8cf expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.157018:0:17036:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782241410.157024:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a8c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a8cf expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.157029:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a8c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a8cf expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.157040:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241410.157041:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241410.157042:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241410.157048:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241410.157058:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140043136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241410.157084:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241410.157104:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241410.157108:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140043264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241410.157124:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241410.157155:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140043136 00000100:00100000:2.0:1782241410.157159:0:17033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140043136 00010000:00010000:2.0:1782241410.157188:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a993 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a98c expref: 18 pid: 17041 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241410.157203:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140043264 00000100:00100000:2.0:1782241410.157205:0:17033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140043264 00010000:00010000:2.0:1782241410.157214:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1a8cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a8c8 expref: 19 pid: 17039 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241410.157224:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241410.157229:0:17033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+19:3637:x1868815140043136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241410.157245:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241410.157251:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a993 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a98c expref: 19 pid: 17041 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.157261:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a993 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a98c expref: 19 pid: 17041 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.157275:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241410.157300:0:17033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+19:3637:x1868815140043136:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241410.157306:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782241410.157317:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782241410.157323:0:17033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:3637:x1868815140043264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241410.157330:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241410.157334:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1a8cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a8c8 expref: 18 pid: 17039 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.157342:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1a8cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a8c8 expref: 18 pid: 17039 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.157354:0:17033:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1a9cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.157362:0:17033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1a9cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782241410.157375:0:17033:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002819330s 00010000:00010000:2.0:1782241410.157379:0:17033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1a9cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.157396:0:17033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1a9cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.157403:0:17033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1a9cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.157409:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1a9cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.157414:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241410.157418:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1a9cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.157425:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1a9cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.157432:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1a9cb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241410.157441:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241410.157466:0:17033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:3637:x1868815140043264:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (339us total) trans 0 rc 0/0 00010000:00010000:1.0:1782241410.157466:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a993 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1a98c expref: 18 pid: 17041 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241410.157472:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782241410.157477:0:17063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1868815140042880:0@lo:104: 00010000:00010000:1.0:1782241410.157500:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1a8cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1a8c8 expref: 16 pid: 17039 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241410.157513:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140043264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782241410.157515:0:17063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1868815140043008:0@lo:104: 00000100:00100000:2.0:1782241410.157519:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140043136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241410.157532:0:17063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1a9cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.157541:0:17063:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1a9cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.157547:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1a9cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241410.157553:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1a9cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782241410.172783:0:17803:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1782241410.172789:0:17803:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1782241410.172972:0:17779:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1782241410.174779:0:17804:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1782241410.175114:0:17779:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1782241410.175475:0:17804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782241410.177207:0:17805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17805:1868815140043392:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1782241410.177279:0:17805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241410.177303:0:17805:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67fff6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241410.177465:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140043392 00000100:00100000:3.0:1782241410.177472:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140043392 00000100:00100000:3.0:1782241410.177532:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782241410.177540:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17805:x1868815140043392:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1782241410.177619:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17805:x1868815140043392:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 80us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241410.177626:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:01000000:2.0:1782241410.178109:0:17779:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1782241410.178168:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782241410.179137:0:17805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17805:1868815140043392:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1782241410.179171:0:17805:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1782241410.179219:0:17805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17805:1868815140043520:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1782241410.179264:0:17805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241410.179283:0:17805:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67fffe40 going to sleep for 11 seconds 00000004:00000080:2.0:1782241410.180075:0:17779:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1782241410.180088:0:17779:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1782241410.180164:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782241410.180457:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140043520 00000100:00100000:3.0:1782241410.180466:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140043520 00000100:00100000:3.0:1782241410.180528:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782241410.180537:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17805:x1868815140043520:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1782241410.180695:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17805:x1868815140043520:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 158us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241410.180702:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782241410.180708:0:17805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17805:1868815140043520:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1782241410.180795:0:17805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17805:1868815140043648:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1782241410.180830:0:17805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241410.180859:0:17805:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67fff6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241410.181220:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140043648 00000100:00100000:3.0:1782241410.181226:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140043648 00000100:00100000:3.0:1782241410.181275:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782241410.181281:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17805:x1868815140043648:12345-0@lo:900:lod0001_rec0000.0 00010000:00080000:0.0:1782241410.181529:0:17805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff890e43f31180 x1868815140043648/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782241426 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241410.181541:0:17805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17805:1868815140043648:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1782241410.181581:0:17805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17805:1868815140043776:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1782241410.181618:0:17805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241410.181638:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140043776 00000100:00100000:0.0:1782241410.181641:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140043776 00000100:00100000:0.0:1782241410.181673:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782241410.181681:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17805:x1868815140043776:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1782241410.181731:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17805:x1868815140043776:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 51us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241410.181745:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782241410.181750:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17805:x1868815140043648:12345-0@lo:900:lod0001_rec0000.0 Request processed in 43us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241410.181778:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782241410.181778:0:17805:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67fffe40 going to sleep for 11 seconds 00000100:00100000:0.0:1782241410.181791:0:17805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17805:1868815140043776:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1782241410.181833:0:17805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782241410.183257:0:17804:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000040:00080000:0.0:1782241410.184459:0:17805:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1782241410.184845:0:17805:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1782241410.185965:0:17804:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1782241410.185971:0:17804:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:2.0:1782241410.186395:0:17779:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1782241410.186971:0:17779:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1782241410.187003:0:17779:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1782241410.187168:0:17779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1782241410.188218:0:17779:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:2.0:1782241410.190323:0:17779:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1782241410.203795:0:17779:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1782241410.203839:0:17779:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa60ac167b988 00100000:10000000:2.0:1782241410.203848:0:17779:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1782241410.204699:0:17779:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782241410.204734:0:17779:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.158@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782241410.204753:0:17779:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1782241410.204792:0:17779:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1782241410.207215:0:17779:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782241410.208551:0:17779:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782241410.821074:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241411.140857:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00000040:00080000:3.0:1782241411.205877:0:17800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1782241411.716855:0:17044:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782241411.716868:0:17044:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d48032000 from 8 10000000:01000000:2.0:1782241411.716875:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782241411.716951:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a9d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241411.716964:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a9d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241411.716978:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a9d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241411.717015:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140043904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782241411.717132:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241411.717210:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241411.717300:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140043904 00000100:00100000:1.0:1782241411.717310:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140043904 00000100:00100000:1.0:1782241411.717386:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782241411.717408:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+16:17044:x1868815140043904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241411.717427:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241411.717445:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a9d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1a9d2 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241411.717486:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a9d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a9d2 expref: 17 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241411.717497:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a9d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a9d2 expref: 17 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241411.717523:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eba00, rc 0) 00000100:00100000:1.0:1782241411.717586:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17044:x1868815140043904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241411.717594:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782241411.719840:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140043904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241411.719879:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a9d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a9d9 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241411.719894:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a9d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a9d9 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241411.719999:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140044032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782241411.720077:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241411.720963:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67fffa80 going to sleep for 11 seconds 00000100:00100000:2.0:1782241411.721099:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140044032 00000100:00100000:2.0:1782241411.721110:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140044032 00000100:00100000:2.0:1782241411.721238:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782241411.721250:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17044:x1868815140044032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1782241411.721293:0:17042:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782241411.721325:0:17042:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782241411.721328:0:17042:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1782241411.721472:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17044:x1868815140044032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 223us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241411.721482:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782241411.721578:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140044032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782241411.721646:0:17044:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782241411.721656:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a9d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a9d9 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241411.721667:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a9d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a9d9 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241411.721678:0:17044:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782241411.721686:0:17044:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d48284800 from 8 10000000:01000000:0.0:1782241411.721689:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782241411.721725:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f0e00/0xc9959f2fb1e1a9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241411.721733:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e778f0e00/0xc9959f2fb1e1a9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241411.721743:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e778f0e00/0xc9959f2fb1e1a9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241411.721782:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140044160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782241411.721816:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241411.723081:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140044160 00000100:00100000:1.0:1782241411.723096:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140044160 00000100:00100000:0.0:1782241411.723108:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67fffa80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241411.723148:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782241411.723157:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17044:x1868815140044160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241411.723172:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241411.723193:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1a9e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1a9e0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241411.723226:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1a9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a9e0 expref: 18 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241411.723238:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1a9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a9e0 expref: 18 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241411.723248:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ebe00, rc 0) 00000100:00100000:1.0:1782241411.723311:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17044:x1868815140044160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241411.723318:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782241411.723471:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140044160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241411.723488:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e778f0e00/0xc9959f2fb1e1a9e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a9e7 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241411.723499:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e778f0e00/0xc9959f2fb1e1a9e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1a9e7 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241411.723577:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140044288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782241411.723619:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241411.723645:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67fffa80 going to sleep for 11 seconds 00000100:00100000:2.0:1782241411.723728:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140044288 00000100:00100000:2.0:1782241411.723734:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140044288 00000100:00100000:2.0:1782241411.723798:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782241411.723806:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17044:x1868815140044288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1782241411.723822:0:17042:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782241411.723841:0:17042:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782241411.723844:0:17042:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1782241411.724000:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17044:x1868815140044288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 194us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241411.724007:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782241411.724108:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140044288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782241411.724161:0:17044:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782241411.724169:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f0e00/0xc9959f2fb1e1a9e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a9e7 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241411.724190:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e778f0e00/0xc9959f2fb1e1a9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a9e7 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241411.848703:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241412.167818:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00000040:00080000:0.0:1782241412.231330:0:17800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782241412.870894:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241413.194583:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00010000:00010000:0.0:1782241413.893234:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241414.221640:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00000001:02000400:0.0:1782241414.469513:0:18048:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782241414.921180:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241415.236900:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 0 seconds 00000100:00100000:3.0:1782241415.432934:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241415.432958:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140044416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241415.433030:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241415.433131:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140044416 00000100:00100000:3.0:1782241415.433140:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140044416 00000100:00100000:3.0:1782241415.433369:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782241415.433391:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140044416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782241415.433431:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1782241415.433485:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140044416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241415.433492:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782241415.433535:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140044416:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1782241415.441540:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1782241415.441546:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1782241415.441550:0:468:0:(import.c:65:import_set_state_nolock()) ffff890e7d549000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782241415.441562:0:468:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff890e7d549000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241415.441593:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a49f80 x1868815140044672/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241415.441610:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782241415.441614:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782241415.441617:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782241415.441619:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782241415.441638:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782241415.441641:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782241415.441644:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782241415.441647:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782241415.441696:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140044928:0@lo:400:kworker.0 00000100:00100000:3.0:1782241415.441723:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3640:1868815140044544:0@lo:400:kworker.0 00000100:00100000:2.0:1782241415.444496:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140044672:0@lo:38:kworker.0 00000100:00100000:3.0:1782241415.444631:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241415.445191:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140044800:0@lo:400:kworker.0 00000100:00100000:3.0:1782241415.445234:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241415.445397:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241415.445427:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140044800 00000100:00100000:3.0:1782241415.445443:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140044800 00000100:00100000:3.0:1782241415.445493:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140044928 00000100:00100000:3.0:1782241415.445496:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140044928 00000100:00100000:3.0:1782241415.445513:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782241415.445520:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140044800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241415.445583:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140044800:12345-0@lo:400:kworker.0 Request processed in 62us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241415.445590:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782241415.445607:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782241415.445613:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140044928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241415.445658:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140044928:12345-0@lo:400:kworker.0 Request processed in 45us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241415.445664:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782241415.445702:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890d45a49180 x1868815140044800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241415.445715:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140044800:0@lo:400:kworker.0 00010000:00080000:3.0:1782241415.445748:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890d45a4ad80 x1868815140044928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241415.445776:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140044928:0@lo:400:kworker.0 00000100:00100000:0.0:1782241415.448658:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140044544 00000100:00100000:0.0:1782241415.448673:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140044544 00000100:00100000:0.0:1782241415.448730:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782241415.448740:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:3640:x1868815140044544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241415.448848:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:3640:x1868815140044544:12345-0@lo:400:kworker.0 Request processed in 108us (4226us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241415.448856:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782241415.448916:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3640:1868815140044544:0@lo:400:kworker.0 00000100:00100000:2.0:1782241415.449149:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241415.449294:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140044672 00000100:00100000:0.0:1782241415.449299:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140044672 00000100:00100000:0.0:1782241415.449328:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782241415.449333:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1868815140044672:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1782241415.449360:0:17052:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:0.0:1782241415.449407:0:17052:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e1a9ee 00000004:00100000:0.0:1782241415.449425:0:17052:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1782241415.449432:0:17052:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000020:00000004:3.0:1782241415.451427:0:18100:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782241415.451643:0:18100:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:0.0:1782241415.473438:0:17052:0:(import.c:65:import_set_state_nolock()) ffff890d469bc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782241415.473564:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1868815140044672:12345-0@lo:38:kworker.0 Request processed in 24226us (24412us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241415.473576:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1782241415.473675:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1782241415.473686:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1782241415.473692:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1782241415.473695:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7d549000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1782241415.473717:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005e2ce330): req@ffff890d45a49500 x1868815140037632/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241415.473738:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140044672:0@lo:38:kworker.0 00000100:00100000:1.0:1782241415.473829:0:17089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241415.473859:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d780 going to sleep for 11 seconds 00000100:00100000:1.0:1782241415.473879:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140037632 00000100:00100000:0.0:1782241415.473884:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140045056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241415.473885:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140037632 00000100:00100000:0.0:1782241415.473912:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241415.473923:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140045056 00000100:00100000:1.0:1782241415.473926:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140045056 00000100:00100000:1.0:1782241415.473939:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782241415.473946:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17089:x1868815140037632:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1782241415.474016:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17089:x1868815140037632:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241415.480943:0:17089:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17089:1868815140037632:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1782241415.480991:0:17089:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1782241415.481043:0:17089:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17089:1868815140045184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1782241415.481111:0:17089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241415.481393:0:17052:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1782241415.481402:0:17052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1782241415.481449:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67fff480 going to sleep for 11 seconds 00000100:00100000:1.0:1782241415.481773:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782241415.481893:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140045184 00000100:00100000:1.0:1782241415.481900:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140045184 00000100:00100000:1.0:1782241415.481931:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782241415.481941:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3639:x1868815140045056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782241415.481976:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1782241415.482045:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3639:x1868815140045056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (8130us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241415.482052:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782241415.482060:0:18102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782241415.482067:0:18102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17089:x1868815140045184:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1782241415.482407:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140045056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241415.482507:0:18102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17089:x1868815140045184:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 440us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241415.482515:0:18102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782241415.482712:0:17089:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17089:1868815140045184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1782241415.482839:0:17089:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17089:1868815140045312:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1782241415.482874:0:17089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241415.482938:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503aa900 going to sleep for 11 seconds 00000100:00100000:2.0:1782241415.485740:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140045312 00000100:00100000:2.0:1782241415.485772:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140045312 00000100:00100000:3.0:1782241415.488488:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782241415.488504:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17089:x1868815140045312:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1782241415.488743:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17089:x1868815140045312:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 241us (5867us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241415.488782:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782241415.490686:0:17089:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17089:1868815140045312:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1782241415.494783:0:17089:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782241415.497519:0:17089:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1782241415.498716:0:17089:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:1.0:1782241415.498723:0:17089:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1782241415.941000:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782241416.450981:0:18151:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782241416.452611:0:18151:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782241416.965513:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782241417.398474:0:18199:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4fd17d20 20000000:00000080:1.0:1782241417.398494:0:18199:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff890e5168f800 uarg=0000000000000000 20000000:01000000:1.0:1782241417.398545:0:18199:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1782241417.398554:0:18199:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1782241417.398558:0:18199:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1782241417.401193:0:18200:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1782241417.401413:0:18199:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1782241417.412970:0:18199:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782241417.413105:0:18199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e8164ce00/0xc9959f2fb1e1a9f5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241417.413126:0:18199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1a89e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a897 expref: 17 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241417.413134:0:18199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e1a9a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a99a expref: 17 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241417.413142:0:18199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e8164ce00/0xc9959f2fb1e1a9f5 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241417.413183:0:18199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e1a9a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1a99a expref: 17 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241417.413197:0:18199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e1a9a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a99a expref: 17 pid: 17039 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241417.413212:0:18199:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18199:1868815140045440:0@lo:104: 00000100:00100000:3.0:1782241417.413277:0:18199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782241417.413329:0:18199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1a89e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1a897 expref: 17 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241417.413336:0:18199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1a89e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a897 expref: 17 pid: 17041 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241417.413354:0:18199:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48136a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18199:1868815140045568:0@lo:104: 00000100:00100000:3.0:1782241417.413373:0:18199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241417.413468:0:18199:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc2480 going to sleep for 11 seconds 00000100:00100000:1.0:1782241417.413651:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140045440 00000100:00100000:1.0:1782241417.413660:0:17031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140045440 00000100:00100000:2.0:1782241417.413727:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140045568 00000100:00100000:2.0:1782241417.413731:0:17030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140045568 00000100:00100000:2.0:1782241417.414202:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782241417.414212:0:17030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+4:18199:x1868815140045568:12345-0@lo:104: 00010000:00010000:2.0:1782241417.414226:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e778f0000/0xc9959f2fb1e1a897 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1a89e expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241417.414734:0:18199:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48136a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18199:1868815140045568:0@lo:104: 00010000:00010000:2.0:1782241417.415108:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782241417.415115:0:17030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+4:18199:x1868815140045568:12345-0@lo:104: Request processed in 906us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241417.415124:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782241417.415145:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782241417.415152:0:17030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+3:18199:x1868815140045440:12345-0@lo:104: 00010000:00010000:2.0:1782241417.415162:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e779ea600/0xc9959f2fb1e1a99a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1a9a1 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241417.415215:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782241417.415220:0:17030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+3:18199:x1868815140045440:12345-0@lo:104: Request processed in 70us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241417.415226:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1782241417.415284:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782241417.415291:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e778f0000/0xc9959f2fb1e1a897 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1a89e expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.415299:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0000 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241417.415303:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e778f0000/0xc9959f2fb1e1a897 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1a89e expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.415313:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e778f0000/0xc9959f2fb1e1a897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1a89e expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241417.415320:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e778f0000/0xc9959f2fb1e1a897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1a89e expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241417.415326:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782241417.415381:0:17036:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e778f0000/0xc9959f2fb1e1a897 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a89e expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.415388:0:17036:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782241417.415492:0:18199:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18199:1868815140045440:0@lo:104: 00010000:00010000:3.0:1782241417.415516:0:18199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e8164ce00/0xc9959f2fb1e1a9f5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241417.415624:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241417.416126:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241417.416129:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241417.416130:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241417.416164:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e779ea600/0xc9959f2fb1e1a99a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1a9a1 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241417.416172:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea600 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:0.0:1782241417.416175:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e779ea600/0xc9959f2fb1e1a99a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1a9a1 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241417.416182:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e779ea600/0xc9959f2fb1e1a99a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1a9a1 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782241417.416199:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e779ea600/0xc9959f2fb1e1a99a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1a9a1 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241417.416205:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782241417.416236:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e779ea600/0xc9959f2fb1e1a99a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a9a1 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241417.416242:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782241417.416268:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e779ea600/0xc9959f2fb1e1a99a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a9a1 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241417.416276:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e779ea600/0xc9959f2fb1e1a99a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a9a1 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241417.416292:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241417.416294:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241417.416295:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241417.416302:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241417.416316:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140045824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241417.416376:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241417.416427:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140045824 00000100:00100000:0.0:1782241417.416433:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140045824 00010000:00010000:0.0:1782241417.416455:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e1a9a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a99a expref: 18 pid: 17039 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241417.416480:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782241417.416488:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:3638:x1868815140045824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782241417.416504:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241417.416515:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e1a9a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a99a expref: 18 pid: 17039 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241417.416658:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e1a9a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a99a expref: 18 pid: 17039 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241417.416676:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e1a9a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1a99a expref: 18 pid: 17039 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241417.416690:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241417.416807:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:3638:x1868815140045824:12345-0@lo:103:ldlm_bl.0 Request processed in 310us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241417.416815:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1782241417.417091:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e778f0000/0xc9959f2fb1e1a897 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a89e expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.417099:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e778f0000/0xc9959f2fb1e1a897 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a89e expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.417114:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241417.417123:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241417.417125:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241417.417179:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782241417.417191:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140045696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241417.417230:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241417.417306:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140045696 00000100:00100000:1.0:1782241417.417311:0:17033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140045696 00010000:00010000:1.0:1782241417.417332:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1a89e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a897 expref: 17 pid: 17041 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241417.417372:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782241417.417379:0:17033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:3639:x1868815140045696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241417.417388:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241417.417393:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1a89e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a897 expref: 17 pid: 17041 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.417401:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1a89e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a897 expref: 17 pid: 17041 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.417412:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1a89e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1a897 expref: 17 pid: 17041 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.417424:0:17033:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e8164ce00/0xc9959f2fb1e1a9f5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.417433:0:17033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164ce00/0xc9959f2fb1e1a9f5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.417448:0:17033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e8164ce00/0xc9959f2fb1e1a9f5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.417456:0:17033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e8164ce00/0xc9959f2fb1e1a9f5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.417462:0:17033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e8164ce00/0xc9959f2fb1e1a9f5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.417476:0:17033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e8164ce00/0xc9959f2fb1e1a9f5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.417482:0:17033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164ce00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241417.417486:0:17033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e8164ce00/0xc9959f2fb1e1a9f5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.417495:0:17033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e8164ce00/0xc9959f2fb1e1a9f5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.417510:0:17033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e8164ce00/0xc9959f2fb1e1a9f5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241417.417637:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241417.417736:0:17033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+16:3639:x1868815140045696:12345-0@lo:103:ldlm_bl.0 Request processed in 357us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241417.417743:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782241417.417987:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140045824:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782241417.418016:0:18199:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e8164ce00/0xc9959f2fb1e1a9f5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241417.418024:0:18199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e8164ce00/0xc9959f2fb1e1a9f5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241417.418030:0:18199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164ce00/0xc9959f2fb1e1a9f5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241417.420947:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140045696:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782241417.989889:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782241418.310593:0:17085:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1782241418.821041:0:17044:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782241418.821050:0:17044:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890d48032000 from 13 10000000:01000000:2.0:1782241418.821056:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782241418.821154:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860400/0xc9959f2fb1e1a9fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241418.821168:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b860400/0xc9959f2fb1e1a9fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241418.821180:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b860400/0xc9959f2fb1e1a9fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241418.821205:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140045952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782241418.821284:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241418.821347:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85780 going to sleep for 11 seconds 00000100:00100000:1.0:1782241418.821408:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140045952 00000100:00100000:1.0:1782241418.821416:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140045952 00000100:00100000:1.0:1782241418.821476:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782241418.821485:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+16:17044:x1868815140045952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241418.821611:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241418.821627:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1aa03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1a9fc expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241418.821650:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1aa03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a9fc expref: 17 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241418.821661:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1aa03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a9fc expref: 17 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241418.821681:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb000, rc 0) 00000100:00100000:1.0:1782241418.823333:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17044:x1868815140045952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1841us (2040us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241418.823345:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782241418.823642:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140045952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241418.823669:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b860400/0xc9959f2fb1e1a9fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa03 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241418.823680:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b860400/0xc9959f2fb1e1a9fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1aa03 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241418.823836:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140046080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241418.823936:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241418.823971:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85780 going to sleep for 11 seconds 00000100:00100000:3.0:1782241418.824451:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140046080 00000100:00100000:3.0:1782241418.824459:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140046080 00000100:00100000:3.0:1782241418.824517:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782241418.824528:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17044:x1868815140046080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241418.824670:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17044:x1868815140046080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241418.824677:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782241418.824907:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140046080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241418.824946:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140046208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782241418.824991:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241418.825016:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e45994b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782241418.825096:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140046208 00000100:00100000:3.0:1782241418.825100:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140046208 00000100:00100000:3.0:1782241418.825130:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782241418.825137:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17044:x1868815140046208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241418.825231:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17044:x1868815140046208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241418.825237:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782241418.825341:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140046208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782241418.826398:0:18263:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1782241418.826928:0:17044:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1782241418.826957:0:17044:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782241418.826969:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860400/0xc9959f2fb1e1a9fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa03 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241418.826979:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b860400/0xc9959f2fb1e1a9fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa03 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241418.826990:0:17044:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782241418.826992:0:17044:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890d48284800 from 13 10000000:01000000:3.0:1782241418.826995:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782241418.827032:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164ce00/0xc9959f2fb1e1aa0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241418.827040:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164ce00/0xc9959f2fb1e1aa0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241418.827051:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164ce00/0xc9959f2fb1e1aa0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241418.827074:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140046336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782241418.827127:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241418.827168:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc2840 going to sleep for 11 seconds 00000100:00100000:1.0:1782241418.827226:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140046336 00000100:00100000:1.0:1782241418.827232:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140046336 00000100:00100000:1.0:1782241418.827279:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782241418.827288:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+17:17044:x1868815140046336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241418.827301:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241418.827325:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1aa11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1aa0a expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241418.827347:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1aa11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aa0a expref: 18 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241418.827357:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1aa11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aa0a expref: 18 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241418.827366:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb800, rc 0) 00000100:00100000:1.0:1782241418.827414:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17044:x1868815140046336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241418.827422:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782241418.827465:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140046336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241418.827479:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164ce00/0xc9959f2fb1e1aa0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa11 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241418.827487:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164ce00/0xc9959f2fb1e1aa0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1aa11 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241418.827552:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140046464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241418.827578:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241418.827593:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df560c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241418.827604:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140046464 00000100:00100000:1.0:1782241418.827607:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140046464 00000100:00100000:1.0:1782241418.827624:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782241418.827629:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17044:x1868815140046464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241418.827979:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17044:x1868815140046464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241418.827989:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782241418.828022:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140046464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241418.828052:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140046592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782241418.828587:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241418.828612:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df560c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241418.828711:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140046592 00000100:00100000:3.0:1782241418.828725:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140046592 00000100:00100000:3.0:1782241418.828903:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782241418.828912:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17044:x1868815140046592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241418.829177:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:17044:x1868815140046592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241418.829184:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782241418.832945:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140046592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782241418.837372:0:18264:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1782241418.840595:0:17044:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1782241418.840635:0:17044:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782241418.840646:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164ce00/0xc9959f2fb1e1aa0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa11 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241418.840658:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164ce00/0xc9959f2fb1e1aa0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa11 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241419.019876:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241420.046099:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241420.548909:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241420.548934:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140046720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782241420.549071:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140046848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241420.549074:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241420.549111:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241420.549158:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140046720 00000100:00100000:3.0:1782241420.549165:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140046720 00000100:00100000:3.0:1782241420.549219:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140046848 00000100:00100000:3.0:1782241420.549223:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140046848 00000100:00100000:3.0:1782241420.549241:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782241420.549250:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140046720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782241420.549292:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1782241420.549339:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140046720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241420.549347:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782241420.549364:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782241420.549370:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815140046848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782241420.549389:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1782241420.549419:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815140046848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241420.549432:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782241420.549474:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140046720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241420.549540:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241410/real 1782241410] req@ffff890d45a48e00 x1868815140040832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241420 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782241420.549545:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241420.549550:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241420.549554:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241420.549563:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782241420.549580:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890d45a48e00 x1868815140040832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241420 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782241420.549583:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241420.549590:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241420.549594:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241420.549598:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782241420.549601:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241410/real 1782241410] req@ffff890e43f32300 x1868815140040576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241420 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241420.549619:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e43f32300 x1868815140040576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241420 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782241420.549633:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d469bc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1782241420.549634:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3640:1868815140046976:0@lo:400:kworker.0 00000100:00100000:0.0:1782241420.549672:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241420.549707:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140047104:0@lo:400:kworker.0 00000100:00100000:0.0:1782241420.549737:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241420.549844:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140047232:0@lo:400:kworker.0 00000100:00100000:0.0:1782241420.549873:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140047104 00000100:00100000:0.0:1782241420.549879:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140047104 00000100:00100000:2.0:1782241420.549880:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241420.549917:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140047232 00000100:00100000:0.0:1782241420.549921:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140047232 00000100:00100000:2.0:1782241420.549923:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140046976 00000100:00100000:2.0:1782241420.549928:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140046976 00000100:00100000:0.0:1782241420.549941:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782241420.549950:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140047104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241420.549964:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782241420.549974:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d41936050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:3640:x1868815140046976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241420.549994:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140047104:12345-0@lo:400:kworker.0 Request processed in 45us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241420.550002:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782241420.550023:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782241420.550024:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d41936050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:3640:x1868815140046976:12345-0@lo:400:kworker.0 Request processed in 49us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241420.550032:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140047232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241420.550037:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782241420.550072:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140047232:12345-0@lo:400:kworker.0 Request processed in 42us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241420.550079:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1782241420.550109:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890e43f30380 x1868815140047232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1782241420.550118:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890e43f33480 x1868815140047104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241420.550128:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140047232:0@lo:400:kworker.0 00000100:00100000:0.0:1782241420.550134:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140047104:0@lo:400:kworker.0 00000100:00100000:2.0:1782241420.550168:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140046848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241420.550193:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3640:1868815140046976:0@lo:400:kworker.0 00000100:00080000:3.0:1782241420.550268:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782241420.550273:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140040832:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1782241420.550291:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7c69c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782241420.550296:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782241420.550299:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140040576:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1782241420.551410:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241420.551417:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241420.551419:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241420.551422:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241420.551425:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241420.551428:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1782241420.551431:0:468:0:(import.c:65:import_set_state_nolock()) ffff890e7c69c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241420.551437:0:468:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 473 00000100:00080000:0.0:1782241420.551447:0:468:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782241420.551452:0:468:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff890e7c69c800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241420.551477:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e43f33480 x1868815140047360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241420.551491:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241420.551494:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782241420.551496:0:468:0:(import.c:65:import_set_state_nolock()) ffff890d469bc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241420.551498:0:468:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 473 00000100:00080000:0.0:1782241420.551501:0:468:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782241420.551504:0:468:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff890d469bc000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241420.551513:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e43f32a00 x1868815140047488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782241420.551703:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140047360:0@lo:8:kworker.0 00000400:00000100:3.0:1782241420.551748:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140047360 offset 0 length 520: 4 00000100:00100000:3.0:1782241420.552983:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140047488:0@lo:8:kworker.0 00000400:00000100:3.0:1782241420.553018:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140047488 offset 0 length 520: 4 00010000:00010000:0.0:1782241421.065185:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241421.576143:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241406/real 1782241406] req@ffff890d45a4b480 x1868815140038656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241421 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241421.576175:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890d45a4b480 x1868815140038656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241421 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241421.576185:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241406/real 1782241406] req@ffff890d45a4b800 x1868815140038784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241421 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241421.576196:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890d45a4b800 x1868815140038784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241421 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782241421.576216:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e77aae000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782241421.576232:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782241421.576236:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140038656:0@lo:8:kworker.0 00000100:00080000:0.0:1782241421.576250:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e67fa6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782241421.576266:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782241421.576270:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140038784:0@lo:8:kworker.0 00000100:00080000:0.0:1782241421.576342:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241421.576345:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1782241421.576348:0:468:0:(import.c:65:import_set_state_nolock()) ffff890e77aae000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241421.576353:0:468:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:0.0:1782241421.576357:0:468:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1782241421.576364:0:468:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff890e77aae000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241421.576381:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e43f32300 x1868815140047872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241421.576392:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241421.576395:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782241421.576397:0:468:0:(import.c:65:import_set_state_nolock()) ffff890e67fa6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241421.576400:0:468:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:0.0:1782241421.576403:0:468:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1782241421.576406:0:468:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff890e67fa6000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:0.0:1782241421.576416:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e43f31500 x1868815140048000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782241421.576442:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241421.576446:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241421.576449:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241421.576452:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782241421.576486:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140047616:0@lo:400:kworker.0 00000100:00100000:0.0:1782241421.576562:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241421.576602:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815140048384:0@lo:400:kworker.0 00000100:00100000:0.0:1782241421.576626:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241421.576646:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241421.576650:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140047744:0@lo:400:kworker.0 00000100:00100000:0.0:1782241421.576671:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241421.576696:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140048128:0@lo:400:kworker.0 00000100:00100000:0.0:1782241421.576715:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241421.576729:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241421.576733:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140048256:0@lo:400:kworker.0 00000100:00100000:0.0:1782241421.576749:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241421.576793:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140048384 00000100:00100000:0.0:1782241421.576800:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140048384 00000100:00100000:0.0:1782241421.576835:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140048128 00000100:00100000:0.0:1782241421.576837:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140048128 00000100:00100000:0.0:1782241421.576849:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782241421.576856:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815140048384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241421.576898:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815140048384:12345-0@lo:400:kworker.0 Request processed in 42us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241421.576905:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782241421.576918:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241421.576923:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140048128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241421.576952:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140048128:12345-0@lo:400:kworker.0 Request processed in 28us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241421.576958:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241421.576981:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140047744 00000100:00100000:0.0:1782241421.576984:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140047744 00000100:00100000:0.0:1782241421.577002:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140048256 00000100:00100000:0.0:1782241421.577004:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140048256 00000100:00100000:0.0:1782241421.577014:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782241421.577019:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815140047744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241421.577046:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1868815140047744:12345-0@lo:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241421.577052:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782241421.577060:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782241421.577065:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140048256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241421.577083:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140048256:12345-0@lo:400:kworker.0 Request processed in 18us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241421.577089:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782241421.577130:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140048256:0@lo:400:kworker.0 00010000:00080000:0.0:1782241421.577142:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890e43f30380 x1868815140048128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241421.577151:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140048128:0@lo:400:kworker.0 00000100:00100000:0.0:1782241421.577173:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140047872:0@lo:8:kworker.0 00000400:00000100:0.0:1782241421.577198:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140047872 offset 0 length 520: 4 00000100:00100000:0.0:1782241421.577215:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140048000:0@lo:8:kworker.0 00000400:00000100:0.0:1782241421.577232:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868815140048000 offset 0 length 520: 4 00000100:00100000:0.0:1782241421.577269:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140047744:0@lo:400:kworker.0 00010000:00080000:0.0:1782241421.577279:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890e43f30a80 x1868815140048384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241421.577294:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815140048384:0@lo:400:kworker.0 00000100:00100000:3.0:1782241421.585190:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140047616 00000100:00100000:3.0:1782241421.585208:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140047616 00000100:00100000:3.0:1782241421.585291:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782241421.585301:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:3639:x1868815140047616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241421.585400:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:3639:x1868815140047616:12345-0@lo:400:kworker.0 Request processed in 100us (8838us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241421.585424:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782241421.585484:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140047616:0@lo:400:kworker.0 00000001:00100000:1.0:1782241421.587651:0:17780:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1782241422.090032:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782241422.474143:0:17800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782241423.109713:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782241423.541501:0:18549:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782241423.541508:0:18549:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1782241423.541509:0:18549:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1782241423.541642:0:18549:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff890e8140e800 00000020:01000004:2.0:1782241423.541666:0:18549:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1782241423.541686:0:18549:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1782241423.541705:0:18549:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff890e43fe8000) 00000020:00000080:2.0:1782241423.541727:0:18549:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1782241423.669066:0:18549:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1782241423.676958:0:18549:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1782241423.679897:0:18549:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1782241423.680934:0:18549:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1782241423.682341:0:18549:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1782241423.683079:0:18549:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1782241423.683677:0:18549:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1782241423.686693:0:18549:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1782241423.687052:0:18549:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1782241423.687068:0:18549:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782241423.687085:0:18549:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc9959f2fb1e1aa1f 00000020:01000004:1.0:1782241423.687094:0:18549:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1782241423.687137:0:18549:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.158@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782241423.687142:0:18549:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782241423.687149:0:18549:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1782241423.687164:0:18549:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1782241423.687178:0:18549:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff890d46918000) 00000020:00000080:1.0:1782241423.687193:0:18549:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1782241423.697588:0:18549:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782241423.700202:0:18549:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1782241423.700234:0:18549:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1782241423.705922:0:18549:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1782241423.705941:0:18549:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1782241423.708735:0:18549:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1782241423.708753:0:18549:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1782241423.713893:0:18549:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782241423.714117:0:18549:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1782241423.714122:0:18549:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1782241423.716300:0:18549:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1782241423.716317:0:18549:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1782241423.766343:0:18549:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782241423.766576:0:18549:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1782241423.766584:0:18549:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1782241423.768085:0:18549:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782241423.768094:0:18549:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1782241423.769395:0:18549:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1782241423.769405:0:18549:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1782241423.771741:0:18549:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782241423.772481:0:18549:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1782241423.772488:0:18549:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1782241423.773377:0:18549:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1782241423.773386:0:18549:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1782241423.821383:0:18549:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782241423.822742:0:18549:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1782241423.822747:0:18549:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1782241423.833487:0:18549:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1782241423.834006:0:18549:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1782241423.835563:0:18549:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1782241423.835598:0:18549:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1782241423.835605:0:18549:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.158@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1782241423.867652:0:18549:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.158@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782241423.867713:0:18549:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.158@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1782241423.867719:0:18549:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782241423.867721:0:18549:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782241423.867723:0:18549:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241423.867724:0:18549:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241423.867726:0:18549:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241423.867727:0:18549:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241423.867729:0:18549:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241423.867731:0:18549:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241423.867732:0:18549:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782241423.867738:0:18549:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1782241423.867740:0:18549:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782241423.867748:0:18549:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782241423.867749:0:18549:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241423.867750:0:18549:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241423.867750:0:18549:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241423.867752:0:18549:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241423.867752:0:18549:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241423.867753:0:18549:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241423.867754:0:18549:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782241423.867857:0:18549:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782241423.867887:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140048512:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782241423.868002:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241423.868065:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e814ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1782241423.868749:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140048512 00000100:00100000:1.0:1782241423.868805:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140048512 00000100:00100000:1.0:1782241423.868890:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782241423.868901:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:18549:x1868815140048512:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782241423.868995:0:17041:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1782241423.869000:0:17041:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1782241423.869006:0:17041:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1782241423.871698:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:18549:x1868815140048512:12345-0@lo:253:mount.lustre.0 Request processed in 2788us (3686us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241423.871714:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782241423.872143:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140048512:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782241423.872161:0:18549:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782241423.872164:0:18549:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782241423.872165:0:18549:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782241423.872166:0:18549:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782241423.872167:0:18549:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782241423.872169:0:18549:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782241423.872170:0:18549:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782241423.872171:0:18549:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782241423.872173:0:18549:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782241423.872174:0:18549:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782241423.872197:0:18549:0:(tgt_mount.c:101:server_register_mount()) register mount ffff890e8140e800 from lustre-OST0000 10000000:01000000:2.0:1782241423.872270:0:18549:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1782241423.872274:0:18549:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1782241423.872283:0:18549:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff890d4691cd40 local copy 00010000:00010000:2.0:1782241423.872294:0:18549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7e1 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241423.872399:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140048640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241423.872441:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241423.872488:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e814acf00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241423.872644:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140048640 00000100:00100000:3.0:1782241423.872651:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140048640 00000100:00100000:3.0:1782241423.872706:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782241423.872717:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:18549:x1868815140048640:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241423.872821:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:18549:x1868815140048640:12345-0@lo:501:mount.lustre.0 Request processed in 106us (379us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782241423.872828:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782241423.873606:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140048640:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1782241423.873636:0:18549:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1782241423.873663:0:18549:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782241423.873671:0:18549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7e1 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241423.873681:0:18549:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7e1 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241423.873708:0:18549:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff890e8140e800 10000000:01000000:2.0:1782241423.873713:0:18549:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782241423.873718:0:18549:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1782241423.873721:0:18549:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782241423.873725:0:18549:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1782241423.873728:0:18549:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782241423.874305:0:18549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241423.874316:0:18549:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241423.874328:0:18549:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241423.874438:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140048768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782241423.874682:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241423.874726:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e814acf00 going to sleep for 11 seconds 00000100:00100000:1.0:1782241423.875055:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140048768 00000100:00100000:1.0:1782241423.875063:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140048768 00000100:00100000:1.0:1782241423.875115:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782241423.875124:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+18:18549:x1868815140048768:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241423.875139:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241423.875155:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1aa34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1aa2d expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241423.875178:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1aa34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aa2d expref: 19 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241423.875189:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779eb600/0xc9959f2fb1e1aa34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aa2d expref: 19 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241423.875198:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779eb600, rc 0) 00000100:00100000:1.0:1782241423.875262:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+19:18549:x1868815140048768:12345-0@lo:101:mount.lustre.0 Request processed in 138us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241423.875269:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782241423.875589:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140048768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241423.875615:0:18549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa34 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241423.875626:0:18549:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1aa34 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782241423.879655:0:18549:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1782241423.884170:0:18549:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782241423.890232:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1782241423.890309:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1782241423.890326:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1782241423.890348:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1782241423.890363:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1782241423.890377:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1782241423.890420:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1782241423.890427:0:18549:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1782241423.890540:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140048896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241423.890608:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241423.890658:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e77963f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782241423.890802:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140048896 00000100:00100000:0.0:1782241423.890810:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140048896 00000100:00100000:0.0:1782241423.890862:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782241423.890873:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+19:18549:x1868815140048896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241423.891153:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+19:18549:x1868815140048896:12345-0@lo:501:mount.lustre.0 Request processed in 281us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241423.891164:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782241423.891197:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140048896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241423.891253:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140049024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241423.891296:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241423.891339:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140049024 00000100:00100000:3.0:1782241423.891340:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce46b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782241423.891345:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140049024 00000100:00100000:0.0:1782241423.891379:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782241423.891385:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+19:18549:x1868815140049024:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782241423.893107:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+19:18549:x1868815140049024:12345-0@lo:503:mount.lustre.0 Request processed in 1701us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241423.893126:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782241423.893253:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140049024:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782241423.893743:0:18549:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782241423.893877:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140049152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241423.893955:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241423.893997:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce46b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241423.894563:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140049152 00000100:00100000:2.0:1782241423.894570:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140049152 00000100:00100000:2.0:1782241423.894629:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782241423.894639:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+19:18549:x1868815140049152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241423.895310:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+19:18549:x1868815140049152:12345-0@lo:502:mount.lustre.0 Request processed in 671us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241423.895320:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782241423.896053:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140049152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241423.896302:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1782241423.896334:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1782241423.896349:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1782241423.896362:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1782241423.897021:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1782241423.897047:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1782241423.897062:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1782241423.897075:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1782241423.897087:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1782241423.897098:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1782241423.897113:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1782241423.897124:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1782241423.897161:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140049280:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241423.897237:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241423.897270:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce46b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782241423.897335:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140049280 00000100:00100000:0.0:1782241423.897342:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140049280 00000100:00100000:0.0:1782241423.897398:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782241423.897408:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+19:18549:x1868815140049280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241423.897517:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+19:18549:x1868815140049280:12345-0@lo:502:mount.lustre.0 Request processed in 109us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241423.897525:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782241423.897821:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140049280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241423.897863:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1782241423.897873:0:18549:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1782241423.924057:0:18566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782241423.924073:0:18566:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1782241423.924082:0:18566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241423.924084:0:18566:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1782241423.924094:0:18566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782241423.924112:0:18566:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff890e43fecd40) 00000020:00000080:2.0:1782241423.924139:0:18566:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782241423.924146:0:18566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782241423.924267:0:18566:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e8140e800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1782241423.924276:0:18566:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782241423.924285:0:18566:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc9959f2fb1e1aa42 00010000:00010000:2.0:1782241423.933552:0:18566:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1782241423.935064:0:18566:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1782241423.938975:0:18566:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1782241423.942191:0:18566:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1782241423.942201:0:18566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241423.942207:0:18566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241423.942220:0:18566:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1782241423.942224:0:18566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782241423.942227:0:18566:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1782241423.942228:0:18566:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782241423.942230:0:18566:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782241423.942231:0:18566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782241423.942234:0:18566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241423.942235:0:18566:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782241423.942238:0:18566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241423.942241:0:18566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241423.942242:0:18566:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782241423.942244:0:18566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782241423.942246:0:18566:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782241423.942248:0:18566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241423.942250:0:18566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241423.942251:0:18566:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782241423.942254:0:18566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241423.942255:0:18566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241423.942256:0:18566:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782241423.942259:0:18566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1782241423.942286:0:18566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241423.942288:0:18566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241423.942289:0:18566:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782241423.942297:0:18566:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1782241423.942510:0:18549:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1782241423.942544:0:18549:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782241423.942569:0:18549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa34 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241423.942580:0:18549:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b860200/0xc9959f2fb1e1aa2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa34 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241423.942587:0:18549:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e8140e800 from 1 10000000:01000000:3.0:1782241423.942590:0:18549:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782241423.942635:0:18549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e1aa49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241423.942643:0:18549:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e1aa49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241423.942653:0:18549:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e1aa49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241423.942676:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140049408:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782241423.942747:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241423.942815:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce46b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782241423.946457:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140049408 00000100:00100000:2.0:1782241423.946472:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140049408 00000100:00100000:2.0:1782241423.946612:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782241423.946623:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+19:18549:x1868815140049408:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782241423.946641:0:17042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241423.946659:0:17042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e1aa50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1aa49 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241423.946687:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e1aa50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aa49 expref: 20 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241423.946698:0:17042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e1aa50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aa49 expref: 20 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241423.946714:0:17042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4b861200, rc 0) 00000100:00100000:2.0:1782241423.946802:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:18549:x1868815140049408:12345-0@lo:101:mount.lustre.0 Request processed in 181us (4054us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241423.946810:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782241423.946891:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140049408:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241423.946910:0:18549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e1aa49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa50 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241423.946919:0:18549:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e1aa49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1aa50 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782241423.951563:0:18549:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1782241423.951985:0:18549:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782241423.952260:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1782241423.952285:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1782241423.952303:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1782241423.952308:0:18549:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1782241423.954837:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140049536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241423.954918:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241423.954952:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df56780 going to sleep for 11 seconds 00000100:00100000:2.0:1782241423.955077:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140049536 00000100:00100000:2.0:1782241423.955084:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140049536 00000100:00100000:2.0:1782241423.955136:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782241423.955145:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:18549:x1868815140049536:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241423.955312:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:18549:x1868815140049536:12345-0@lo:501:mount.lustre.0 Request processed in 167us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241423.955320:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782241423.956429:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140049536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241423.957191:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140049664:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782241423.957270:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241423.957341:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df56780 going to sleep for 11 seconds 00000100:00100000:3.0:1782241423.957389:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140049664 00000100:00100000:3.0:1782241423.957396:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140049664 00000100:00100000:3.0:1782241423.957444:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782241423.957453:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:18549:x1868815140049664:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241423.957748:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:18549:x1868815140049664:12345-0@lo:503:mount.lustre.0 Request processed in 295us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241423.957790:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782241423.957908:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140049664:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782241423.959954:0:18549:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782241423.960092:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140049792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241423.960175:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241423.960275:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df56d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782241423.965035:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140049792 00000100:00100000:3.0:1782241423.965049:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140049792 00000100:00100000:3.0:1782241423.967316:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782241423.967338:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:18549:x1868815140049792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241423.967541:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:18549:x1868815140049792:12345-0@lo:502:mount.lustre.0 Request processed in 201us (7355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241423.967549:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782241423.967856:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140049792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782241423.968085:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1782241423.968120:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1782241423.968135:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1782241423.968149:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1782241423.968161:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1782241423.968173:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1782241423.968191:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1782241423.968205:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1782241423.968230:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1782241423.968242:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1782241423.968254:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1782241423.968288:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140049920:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782241423.968338:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241423.968381:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e814ac6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241423.968513:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140049920 00000100:00100000:3.0:1782241423.968521:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140049920 00000100:00100000:3.0:1782241423.968575:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782241423.968583:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:18549:x1868815140049920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241423.968676:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:18549:x1868815140049920:12345-0@lo:502:mount.lustre.0 Request processed in 94us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241423.968684:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782241423.968724:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140049920:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782241423.968799:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1782241423.968809:0:18549:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1782241423.969936:0:18570:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782241423.969947:0:18570:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241423.969950:0:18570:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782241423.969955:0:18570:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890e8140e800 00000020:00000080:0.0:1782241423.969958:0:18570:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782241423.969967:0:18570:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241423.969970:0:18570:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241423.969972:0:18570:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782241423.969974:0:18570:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782241423.969977:0:18570:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241423.969978:0:18570:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782241423.969981:0:18570:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890e8140e800 00000020:00000080:0.0:1782241423.969983:0:18570:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782241423.970086:0:18570:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241423.970091:0:18570:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241423.970092:0:18570:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1782241423.970095:0:18570:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782241423.970098:0:18570:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241423.970105:0:18570:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782241423.970110:0:18570:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890e8140e800 00000020:00000080:0.0:1782241423.970112:0:18570:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782241423.974949:0:18570:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241423.974969:0:18570:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241423.974971:0:18570:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782241423.974975:0:18570:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782241423.974979:0:18570:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241423.974980:0:18570:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1782241423.974985:0:18570:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890e8140e800 00000020:00000080:0.0:1782241423.974987:0:18570:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782241423.975044:0:18570:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782241423.975047:0:18570:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782241423.975048:0:18570:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1782241423.975051:0:18570:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1782241423.982981:0:18549:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1782241423.983030:0:18549:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782241423.983058:0:18549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e1aa49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa50 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241423.983071:0:18549:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e1aa49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa50 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241423.983152:0:18549:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782241423.983155:0:18549:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff890e8140e800 10000000:01000000:2.0:1782241423.983158:0:18549:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff890e8140e800 10000000:01000000:2.0:1782241423.983162:0:18549:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782241423.983167:0:18549:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e8140e800 from 1 10000000:01000000:2.0:1782241423.983170:0:18549:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782241423.983208:0:18549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241423.983226:0:18549:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241423.983238:0:18549:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241423.983267:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140050048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782241423.983339:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241423.983387:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e814ac6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241423.984236:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140050048 00000100:00100000:1.0:1782241423.984245:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140050048 00000100:00100000:1.0:1782241423.984304:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782241423.984314:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:18549:x1868815140050048:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241423.984332:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241423.984346:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779ea800/0xc9959f2fb1e1aa5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1aa57 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241423.984512:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779ea800/0xc9959f2fb1e1aa5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aa57 expref: 21 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241423.984523:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779ea800/0xc9959f2fb1e1aa5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aa57 expref: 21 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241423.984534:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea800, rc 0) 00000100:00100000:1.0:1782241423.984656:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:18549:x1868815140050048:12345-0@lo:101:mount.lustre.0 Request processed in 342us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241423.984663:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782241423.991700:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140050048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782241423.991733:0:18549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa5e expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241423.991835:0:18549:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1aa5e expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782241423.999231:0:18549:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1782241424.000707:0:18549:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782241424.003786:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1782241424.003825:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1782241424.003839:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1782241424.003851:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1782241424.003863:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1782241424.003876:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1782241424.003888:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1782241424.003901:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1782241424.003912:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1782241424.003923:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1782241424.003935:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1782241424.003945:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1782241424.003957:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1782241424.003969:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1782241424.003982:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1782241424.004011:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1782241424.004028:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1782241424.004039:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1782241424.004051:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1782241424.004064:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1782241424.004078:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1782241424.004091:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1782241424.004104:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1782241424.004117:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1782241424.004130:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1782241424.004141:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1782241424.004175:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1782241424.004189:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1782241424.004201:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1782241424.004226:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1782241424.004242:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1782241424.004271:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1782241424.004285:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1782241424.004297:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1782241424.004311:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1782241424.004323:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1782241424.004335:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1782241424.004353:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1782241424.004359:0:18549:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1782241424.006373:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140050176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241424.008572:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241424.008635:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140050176 00000100:00100000:2.0:1782241424.008643:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140050176 00000100:00100000:2.0:1782241424.008701:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782241424.008710:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:18549:x1868815140050176:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241424.008881:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:18549:x1868815140050176:12345-0@lo:501:mount.lustre.0 Request processed in 171us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241424.008888:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782241424.008948:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e814acf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782241424.008970:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140050176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241424.009017:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140050304:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782241424.009062:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241424.009084:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e814acf00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241424.009270:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140050304 00000100:00100000:3.0:1782241424.009275:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140050304 00000100:00100000:3.0:1782241424.009301:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782241424.009308:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:18549:x1868815140050304:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241424.009476:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:18549:x1868815140050304:12345-0@lo:503:mount.lustre.0 Request processed in 168us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241424.009483:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782241424.009548:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140050304:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782241424.009985:0:18549:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782241424.010067:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48136300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140050432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241424.010106:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241424.010133:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140050432 00000100:00100000:3.0:1782241424.010137:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140050432 00000100:00100000:3.0:1782241424.010157:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782241424.010163:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:18549:x1868815140050432:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241424.016149:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:18549:x1868815140050432:12345-0@lo:502:mount.lustre.0 Request processed in 5974us (6032us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241424.016166:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782241424.016253:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce46240 going to sleep for 11 seconds 00000100:00100000:3.0:1782241424.016282:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48136300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140050432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241424.016555:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1782241424.016589:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1782241424.016602:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1782241424.016614:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1782241424.016627:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1782241424.016639:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1782241424.016651:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1782241424.016662:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1782241424.016674:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1782241424.016686:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1782241424.016701:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1782241424.016712:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1782241424.016724:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1782241424.016737:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1782241424.016749:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1782241424.016819:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1782241424.016835:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1782241424.016849:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1782241424.016859:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1782241424.016869:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1782241424.016879:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1782241424.016890:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1782241424.016902:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1782241424.016914:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1782241424.016925:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1782241424.016937:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1782241424.016949:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1782241424.016960:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1782241424.016973:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1782241424.016986:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1782241424.016999:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1782241424.017025:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1782241424.017046:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1782241424.017059:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1782241424.017071:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1782241424.017084:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1782241424.017096:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1782241424.017108:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1782241424.017121:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1782241424.017134:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1782241424.017146:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1782241424.017158:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1782241424.017171:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1782241424.017185:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1782241424.017200:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1782241424.017225:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1782241424.017240:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1782241424.017266:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1782241424.017315:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48136300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140050560:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241424.017369:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241424.017405:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce46240 going to sleep for 11 seconds 00000100:00100000:1.0:1782241424.017575:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140050560 00000100:00100000:1.0:1782241424.017583:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140050560 00000100:00100000:1.0:1782241424.017634:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782241424.017644:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:18549:x1868815140050560:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782241424.017748:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:18549:x1868815140050560:12345-0@lo:502:mount.lustre.0 Request processed in 105us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241424.017775:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782241424.019582:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48136300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140050560:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241424.022650:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1782241424.022714:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1782241424.022779:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48136300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140050688:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241424.022861:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241424.022901:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce46240 going to sleep for 11 seconds 00000100:00100000:3.0:1782241424.022926:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140050688 00000100:00100000:3.0:1782241424.022932:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140050688 00000100:00100000:3.0:1782241424.022990:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782241424.023001:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:18549:x1868815140050688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241424.023128:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:18549:x1868815140050688:12345-0@lo:502:mount.lustre.0 Request processed in 128us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241424.023135:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782241424.023198:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48136300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140050688:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782241424.023259:0:18549:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1782241424.024280:0:18549:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1782241424.029259:0:18576:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1782241424.029283:0:18576:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff890e43633380) 00000020:00000080:2.0:1782241424.029307:0:18576:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1782241424.029744:0:18576:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e8140e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782241424.029749:0:18576:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e8140e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782241424.029752:0:18576:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e8140e800 3 00010000:00080000:2.0:1782241424.029809:0:18576:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890e4548d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241424.035478:0:18576:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1782241424.035831:0:18576:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1782241424.035880:0:18576:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782241424.035900:0:18576:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc9959f2fb1e1aa6c 00000100:00080000:1.0:1782241424.035911:0:18576:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782241424.035917:0:18576:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff890e4548d800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241424.035952:0:18576:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a4b480 x1868815140050816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241424.035981:0:18576:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782241424.038527:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1868815140050816:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782241424.038608:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782241424.038708:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241424.038712:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241424.038715:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241424.038718:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241424.038740:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241424.038742:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241424.038746:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241424.038748:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782241424.038802:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140050816 00000100:00100000:0.0:1782241424.038810:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140050816 00000100:00100000:0.0:1782241424.038853:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782241424.038861:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1868815140050816:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1782241424.038890:0:17049:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1782241424.038934:0:17049:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc9959f2fb1e1aa73 00000004:00100000:0.0:1782241424.038951:0:17049:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782241424.038987:0:17049:0:(import.c:65:import_set_state_nolock()) ffff890e7c699800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782241424.039065:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1868815140050816:12345-0@lo:38:llog_process_th.0 Request processed in 202us (456us total) trans 0 rc 0/0 00010000:00080000:2.0:1782241424.039159:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890d45a4b480 x1868815140050816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241424.039170:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782241424.039178:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1782241424.039185:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782241424.039189:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782241424.039192:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e4548d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782241424.039197:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1868815140050816:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1782241424.040186:0:18576:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1782241424.040309:0:18576:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff890e503f0000) 00000020:00000080:1.0:1782241424.040333:0:18576:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1782241424.040523:0:18576:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e8140e800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782241424.040527:0:18576:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e8140e800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782241424.040539:0:18576:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e8140e800 3 00010000:00080000:1.0:1782241424.040569:0:18576:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890d47b7c000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.158@tcp at head 00000100:00100000:0.0:1782241424.040753:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782241424.040810:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140050944:0@lo:400:kworker.0 00000100:00100000:0.0:1782241424.040865:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241424.040897:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782241424.040904:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140051328:0@lo:400:kworker.0 00000100:00100000:0.0:1782241424.040929:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241424.041089:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140051072:0@lo:400:kworker.0 00000100:00100000:0.0:1782241424.041118:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241424.041139:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241424.041146:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140051200:0@lo:400:kworker.0 00000100:00100000:0.0:1782241424.041169:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241424.041217:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140051328 00000100:00100000:0.0:1782241424.041224:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140051328 00000100:00100000:0.0:1782241424.041255:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140051072 00000100:00100000:0.0:1782241424.041259:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140051072 00000100:00100000:0.0:1782241424.041275:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782241424.041283:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815140051328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241424.041333:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815140051328:12345-0@lo:400:kworker.0 Request processed in 50us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241424.041348:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782241424.041361:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782241424.041368:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140051072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241424.041402:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140051072:12345-0@lo:400:kworker.0 Request processed in 35us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241424.041408:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782241424.041430:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140050944 00000100:00100000:0.0:1782241424.041433:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140050944 00000100:00100000:0.0:1782241424.041453:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140051200 00000100:00100000:0.0:1782241424.042292:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140051200 00000100:00100000:0.0:1782241424.042324:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782241424.042331:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140050944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241424.042374:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140050944:12345-0@lo:400:kworker.0 Request processed in 44us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241424.042380:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782241424.042394:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782241424.042400:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140051200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241424.042428:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140051200:12345-0@lo:400:kworker.0 Request processed in 28us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241424.042433:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782241424.042504:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140051200:0@lo:400:kworker.0 00010000:00080000:0.0:1782241424.042519:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890e7f684000 x1868815140051072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241424.042541:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140051072:0@lo:400:kworker.0 00010000:00080000:0.0:1782241424.042582:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890e7f686d80 x1868815140051328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241424.042599:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140051328:0@lo:400:kworker.0 00000100:00100000:0.0:1782241424.042612:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140050944:0@lo:400:kworker.0 00010000:00010000:1.0:1782241424.046457:0:18576:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1782241424.047510:0:18576:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1782241424.047850:0:18576:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782241424.047861:0:18576:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc9959f2fb1e1aa81 00000100:00080000:1.0:1782241424.047872:0:18576:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782241424.047878:0:18576:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff890d47b7c000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241424.047912:0:18576:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a48e00 x1868815140051456/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241424.047934:0:18576:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1782241424.048073:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1868815140051456:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782241424.048137:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782241424.048845:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241424.048852:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241424.048856:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241424.048859:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241424.048863:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241424.048866:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241424.048869:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241424.048872:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782241424.049875:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140051456 00000100:00100000:1.0:1782241424.049885:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140051456 00000100:00100000:1.0:1782241424.049932:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782241424.049940:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1868815140051456:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782241424.049972:0:17048:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:1.0:1782241424.050007:0:17048:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc9959f2fb1e1aa88 00000004:00100000:1.0:1782241424.050031:0:17048:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782241424.050064:0:17048:0:(import.c:65:import_set_state_nolock()) ffff890d47b7b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241424.050137:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1868815140051456:12345-0@lo:38:llog_process_th.0 Request processed in 197us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241424.050145:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1782241424.050258:0:18576:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1782241424.050457:0:18549:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1782241424.050488:0:18549:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782241424.050505:0:18549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa5e expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241424.050516:0:18549:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b860e00/0xc9959f2fb1e1aa57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa5e expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782241424.050569:0:18549:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782241424.050571:0:18549:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782241424.050573:0:18549:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241424.050574:0:18549:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241424.050575:0:18549:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241424.050576:0:18549:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241424.050578:0:18549:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782241424.050580:0:18549:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241424.050581:0:18549:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782241424.050585:0:18549:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1782241424.050587:0:18549:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782241424.050588:0:18549:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782241424.050589:0:18549:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241424.050590:0:18549:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241424.050591:0:18549:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241424.050593:0:18549:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241424.050594:0:18549:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782241424.050595:0:18549:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241424.050596:0:18549:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782241424.050618:0:18549:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1782241424.050642:0:18549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48136300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140051584:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782241424.050870:0:18549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241424.050899:0:18549:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4ce46c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241424.050915:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140051584 00000100:00100000:3.0:1782241424.050919:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140051584 00000100:00100000:3.0:1782241424.050953:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782241424.050959:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e505a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:18549:x1868815140051584:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782241424.050980:0:17042:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1782241424.050992:0:17042:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1782241424.051294:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff890d45a48e00 x1868815140051456/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241424.051305:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782241424.051313:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1782241424.051320:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1782241424.051326:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1782241424.051328:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d47b7c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782241424.051333:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1868815140051456:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1782241424.059404:0:17042:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782241424.059426:0:17042:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1782241424.059544:0:17063:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782241424.059550:0:17063:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782241424.059577:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1aa8f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241424.059597:0:17063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a9d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a9d2 expref: 21 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241424.059607:0:17063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1a9e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a9e0 expref: 21 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241424.059614:0:17063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1aa8f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241424.059684:0:17063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1a9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1a9e0 expref: 21 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241424.059700:0:17063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1a9e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a9e0 expref: 21 pid: 17039 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241424.059716:0:17063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aea680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1868815140051712:0@lo:104: 00000100:00100000:2.0:1782241424.059999:0:17063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241424.060057:0:17063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a9d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1a9d2 expref: 21 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241424.060065:0:17063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a9d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a9d2 expref: 21 pid: 17039 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241424.060073:0:17063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aead80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1868815140051840:0@lo:104: 00000100:00100000:2.0:1782241424.060098:0:17063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241424.060117:0:17063:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e477d8000 going to sleep for 11 seconds 00000100:00100000:3.0:1782241424.060160:0:17030:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782241424.060184:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140051712 00000100:00100000:3.0:1782241424.060191:0:17030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140051712 00000100:00100000:3.0:1782241424.060242:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140051840 00000100:00100000:3.0:1782241424.060245:0:17030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140051840 00000100:00100000:3.0:1782241424.060263:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782241424.060274:0:17030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+4:17063:x1868815140051712:12345-0@lo:104: 00010000:00010000:3.0:1782241424.060292:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e778f0e00/0xc9959f2fb1e1a9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1a9e7 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241424.060374:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782241424.060383:0:17030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+4:17063:x1868815140051712:12345-0@lo:104: Request processed in 111us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241424.060403:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782241424.060404:0:17063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aea680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1868815140051712:0@lo:104: 00000100:00100000:3.0:1782241424.060425:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782241424.060432:0:17030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d478a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+3:17063:x1868815140051840:12345-0@lo:104: 00010000:00010000:3.0:1782241424.060439:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a9d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1a9d9 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241424.060482:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782241424.060487:0:17030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d478a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+3:17063:x1868815140051840:12345-0@lo:104: Request processed in 57us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241424.060492:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1782241424.060535:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1782241424.060540:0:17063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aead80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1868815140051840:0@lo:104: 00010000:00010000:3.0:1782241424.060542:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e778f0e00/0xc9959f2fb1e1a9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1a9e7 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241424.060552:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0e00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241424.060556:0:18201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e778f0e00/0xc9959f2fb1e1a9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1a9e7 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241424.060562:0:17063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1aa8f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241424.060565:0:18201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e778f0e00/0xc9959f2fb1e1a9e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1a9e7 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241424.060581:0:18201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e778f0e00/0xc9959f2fb1e1a9e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1a9e7 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241424.060588:0:18201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241424.060631:0:18201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e778f0e00/0xc9959f2fb1e1a9e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a9e7 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241424.060638:0:18201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241424.060666:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e778f0e00/0xc9959f2fb1e1a9e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a9e7 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241424.060672:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e778f0e00/0xc9959f2fb1e1a9e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a9e7 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241424.060683:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241424.060686:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a9d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1a9d9 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241424.060691:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861400 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241424.060693:0:18201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a9d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1a9d9 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241424.060700:0:18201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a9d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1a9d9 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241424.060706:0:18201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a9d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1a9d9 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241424.060711:0:18201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241424.060729:0:18201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a9d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a9d9 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241424.060734:0:18201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241424.060750:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a9d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a9d9 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241424.060786:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b861400/0xc9959f2fb1e1a9d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1a9d9 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241424.060799:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241424.060801:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241424.060802:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241424.061609:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241424.061771:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e505a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:18549:x1868815140051584:12345-0@lo:253:mount.lustre.0 Request processed in 10794us (10883us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241424.061782:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782241424.062120:0:18549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48136300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:18549:1868815140051584:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782241424.062133:0:18549:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1782241424.062135:0:18549:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782241424.062137:0:18549:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782241424.062138:0:18549:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782241424.062139:0:18549:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782241424.062140:0:18549:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782241424.062142:0:18549:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782241424.062143:0:18549:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782241424.062146:0:18549:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782241424.062147:0:18549:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782241424.062162:0:18549:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1782241424.062816:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241424.062835:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140051968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782241424.062887:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241424.063000:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140051968 00000100:00100000:2.0:1782241424.063008:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140051968 00010000:00010000:2.0:1782241424.063039:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1a9e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a9e0 expref: 21 pid: 17039 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241424.063147:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782241424.063158:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:3639:x1868815140051968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241424.063182:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241424.063188:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1a9e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a9e0 expref: 21 pid: 17039 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241424.063202:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1a9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a9e0 expref: 21 pid: 17039 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241424.063232:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1a9e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1a9e0 expref: 21 pid: 17039 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241424.063246:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241424.063287:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:3639:x1868815140051968:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241424.063293:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782241424.063358:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140051968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241424.064503:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140052096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782241424.065884:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241424.065962:0:17034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140052096 00000100:00100000:1.0:1782241424.065973:0:17034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140052096 00010000:00010000:1.0:1782241424.066018:0:17034:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a9d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a9d2 expref: 20 pid: 17039 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241424.066061:0:17034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782241424.066072:0:17034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d41935050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:3637:x1868815140052096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241424.066086:0:17034:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241424.066091:0:17034:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a9d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a9d2 expref: 20 pid: 17039 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241424.066103:0:17034:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a9d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a9d2 expref: 20 pid: 17039 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241424.066134:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779eba00/0xc9959f2fb1e1a9d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1a9d2 expref: 20 pid: 17039 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241424.066152:0:17034:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1aa8f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241424.066161:0:17034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1aa8f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782241424.066182:0:17034:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006630131s 00010000:00010000:1.0:1782241424.066187:0:17034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1aa8f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241424.066193:0:17034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1aa8f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241424.066199:0:17034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1aa8f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241424.066205:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1aa8f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241424.066224:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241424.066229:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1aa8f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241424.066236:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1aa8f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241424.066253:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1aa8f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241424.066271:0:17034:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241424.066330:0:17034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d41935050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+19:3637:x1868815140052096:12345-0@lo:103:ldlm_bl.0 Request processed in 261us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241424.066339:0:17034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782241424.066423:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140052096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241424.066451:0:17063:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1aa8f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241424.066458:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1aa8f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241424.066464:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b861600/0xc9959f2fb1e1aa8f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1782241424.079491:0:18549:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1782241424.081942:0:18549:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1782241424.081951:0:18549:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1782241424.081997:0:18549:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782241424.082041:0:18549:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.158@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782241424.082060:0:18549:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1782241424.082078:0:18549:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1782241424.082969:0:18549:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782241424.083179:0:18549:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782241424.134215:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782241425.051387:0:18629:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782241425.051585:0:18629:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782241425.163269:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782241425.478165:0:17044:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782241425.478173:0:17044:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d48032000 from 9 10000000:01000000:2.0:1782241425.478178:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782241425.478239:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e1aa96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241425.478252:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e1aa96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241425.478264:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e1aa96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241425.478292:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140052224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782241425.478367:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241425.479723:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241425.479741:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140052224 00000100:00100000:3.0:1782241425.479789:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140052224 00000100:00100000:3.0:1782241425.479848:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782241425.479858:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e505a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+19:17044:x1868815140052224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241425.479873:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241425.479892:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1aa9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1aa96 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241425.479919:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1aa9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aa96 expref: 20 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241425.479930:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1aa9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aa96 expref: 20 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241425.479938:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d000, rc 0) 00000100:00100000:3.0:1782241425.480007:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e505a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:17044:x1868815140052224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241425.480014:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782241425.480174:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140052224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241425.480209:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e1aa96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa9d expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241425.480219:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e1aa96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1aa9d expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241425.480275:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140052352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782241425.480311:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241425.480405:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241425.482339:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140052352 00000100:00100000:3.0:1782241425.482351:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140052352 00000100:00100000:2.0:1782241425.482654:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782241425.482668:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e505a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:17044:x1868815140052352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1782241425.482694:0:17042:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782241425.482721:0:17042:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782241425.482724:0:17042:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1782241425.482890:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e505a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:17044:x1868815140052352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 224us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241425.482898:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782241425.484370:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140052352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1782241425.484520:0:17044:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782241425.484531:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e1aa96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa9d expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241425.484614:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e1aa96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aa9d expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241425.484627:0:17044:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782241425.484630:0:17044:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d48284800 from 9 10000000:01000000:2.0:1782241425.488605:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782241425.488671:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860600/0xc9959f2fb1e1aaa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241425.488684:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b860600/0xc9959f2fb1e1aaa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241425.488697:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b860600/0xc9959f2fb1e1aaa4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241425.488724:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140052480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782241425.488821:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241425.488878:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140052480 00000100:00100000:0.0:1782241425.488888:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140052480 00000100:00100000:0.0:1782241425.488957:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782241425.488967:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e505a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:17044:x1868815140052480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241425.488983:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1782241425.488996:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1782241425.488997:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e1aaab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1aaa4 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241425.489027:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e1aaab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aaa4 expref: 21 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241425.489050:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e1aaab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aaa4 expref: 21 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241425.489059:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0000, rc 0) 00000100:00100000:0.0:1782241425.489110:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e505a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:17044:x1868815140052480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241425.489117:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782241425.489259:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140052480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782241425.489274:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b860600/0xc9959f2fb1e1aaa4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aaab expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241425.489283:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b860600/0xc9959f2fb1e1aaa4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1aaab expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241425.489329:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140052608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782241425.489359:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241425.489440:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4536d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241425.489540:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140052608 00000100:00100000:0.0:1782241425.489544:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140052608 00000100:00100000:0.0:1782241425.489579:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782241425.489586:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e820d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:17044:x1868815140052608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782241425.489602:0:17042:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782241425.489620:0:17042:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782241425.489624:0:17042:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1782241425.490239:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e820d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:17044:x1868815140052608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 649us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241425.490248:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782241425.493293:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140052608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1782241425.493388:0:17044:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782241425.493399:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b860600/0xc9959f2fb1e1aaa4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aaab expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241425.493422:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b860600/0xc9959f2fb1e1aaa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aaab expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241425.668968:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140052736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241425.669058:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241425.669883:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140052736 00000100:00100000:1.0:1782241425.669893:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140052736 00000100:00100000:1.0:1782241425.669950:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782241425.669959:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140052736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782241425.669996:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1782241425.670067:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140052736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241425.670075:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782241425.670159:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140052736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241425.671080:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140052864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241425.671130:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241425.671309:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140052864 00000100:00100000:0.0:1782241425.671316:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140052864 00000100:00100000:0.0:1782241425.671360:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782241425.671369:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140052864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241425.671418:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782241425.671471:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140052864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241425.671479:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782241425.671879:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140052864:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782241426.181385:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241427.205515:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241428.229746:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782241428.549439:0:17085:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782241429.252940:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782241429.258678:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241429.258684:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241429.258686:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241429.258689:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241429.258704:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241429.258707:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782241429.258709:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782241429.258712:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782241429.258749:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140053120:0@lo:400:kworker.0 00000100:00100000:2.0:1782241429.258824:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241429.258867:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140053632:0@lo:400:kworker.0 00000100:00100000:2.0:1782241429.258888:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241429.258909:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782241429.258915:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140053248:0@lo:400:kworker.0 00000100:00100000:2.0:1782241429.258939:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241429.258952:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140053760:0@lo:400:kworker.0 00000100:00100000:1.0:1782241429.259066:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3640:1868815140052992:0@lo:400:kworker.0 00000100:00100000:1.0:1782241429.259119:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241429.259147:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140053504:0@lo:400:kworker.0 00000100:00100000:1.0:1782241429.259167:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241429.259182:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782241429.259187:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140053376:0@lo:400:kworker.0 00000100:00100000:1.0:1782241429.259209:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241429.259238:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140053120 00000100:00100000:1.0:1782241429.259245:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140053120 00000100:00100000:1.0:1782241429.259284:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140053376 00000100:00100000:1.0:1782241429.259287:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140053376 00000100:00100000:1.0:1782241429.259304:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782241429.259312:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140053120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241429.259359:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140053120:12345-0@lo:400:kworker.0 Request processed in 47us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241429.259367:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782241429.259383:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782241429.259390:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140053376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241429.259419:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140053376:12345-0@lo:400:kworker.0 Request processed in 30us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241429.259426:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782241429.259443:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140053632 00000100:00100000:1.0:1782241429.259446:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140053632 00000100:00100000:1.0:1782241429.259481:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140053248 00000100:00100000:1.0:1782241429.259484:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140053248 00000100:00100000:1.0:1782241429.259494:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140053504 00000100:00100000:1.0:1782241429.259497:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140053504 00000100:00100000:1.0:1782241429.259510:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782241429.259516:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140053632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241429.259554:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140053632:12345-0@lo:400:kworker.0 Request processed in 38us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241429.259561:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782241429.259573:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241429.259578:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140053248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241429.259602:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140053248:12345-0@lo:400:kworker.0 Request processed in 24us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241429.259607:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241429.259616:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782241429.259622:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815140053504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241429.259646:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1868815140053504:12345-0@lo:400:kworker.0 Request processed in 25us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241429.259651:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782241429.259669:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140052992 00000100:00100000:1.0:1782241429.259672:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140052992 00000100:00100000:1.0:1782241429.259698:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782241429.259704:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e820d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:3640:x1868815140052992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241429.259731:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e820d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:3640:x1868815140052992:12345-0@lo:400:kworker.0 Request processed in 28us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241429.259737:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782241429.259817:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140053376:0@lo:400:kworker.0 00000100:00100000:1.0:1782241429.259828:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3640:1868815140052992:0@lo:400:kworker.0 00010000:00080000:1.0:1782241429.259842:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e47ae8380 x1868815140053504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241429.259867:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1868815140053504:0@lo:400:kworker.0 00000100:00080000:1.0:1782241429.259920:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782241429.260072:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241429.260158:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140053120:0@lo:400:kworker.0 00010000:00080000:2.0:1782241429.260170:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e47ae9f80 x1868815140053632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241429.260178:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140053632:0@lo:400:kworker.0 00010000:00080000:2.0:1782241429.260194:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e47aebb80 x1868815140053248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241429.260202:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140053248:0@lo:400:kworker.0 00000100:00100000:1.0:1782241429.272671:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140053760 00000100:00100000:1.0:1782241429.272687:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140053760 00000100:00100000:1.0:1782241429.272767:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782241429.272777:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140053760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241429.272878:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140053760:12345-0@lo:400:kworker.0 Request processed in 101us (12804us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241429.272885:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1782241429.272906:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1782241429.273204:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e47aead80 x1868815140053760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241429.273220:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140053760:0@lo:400:kworker.0 00000001:02000400:3.0:1782241430.144585:0:18919:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782241430.277955:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241430.789192:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782241430.789215:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140053888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241430.789287:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241430.789365:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140053888 00000100:00100000:0.0:1782241430.789372:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140053888 00000100:00100000:0.0:1782241430.789418:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782241430.789426:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140053888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241430.789461:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1782241430.789508:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140053888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241430.789515:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782241430.789556:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140053888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241430.790376:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140054016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241430.790410:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241430.790475:0:18102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140054016 00000100:00100000:3.0:1782241430.790481:0:18102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140054016 00000100:00100000:3.0:1782241430.790508:0:18102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782241430.790516:0:18102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140054016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782241430.790537:0:18102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1782241430.796004:0:18102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140054016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5479us (5584us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241430.796019:0:18102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782241430.800397:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140054016:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1782241431.087255:0:18971:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782241431.088450:0:18971:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782241431.302058:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782241432.001147:0:19021:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782241432.001363:0:19021:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782241432.325599:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782241432.709425:0:17800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782241433.349237:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241434.373769:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140054144:0@lo:400:kworker.0 00000100:00100000:3.0:1782241434.373847:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241434.373954:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140054144 00000100:00100000:2.0:1782241434.373962:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140054144 00000100:00100000:2.0:1782241434.374021:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1782241434.374030:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4c44c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:3637:x1868815140054144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241434.374946:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140054272:0@lo:400:kworker.0 00000100:00100000:1.0:1782241434.374991:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241434.375046:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140054272 00000100:00100000:1.0:1782241434.375052:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140054272 00000100:00100000:1.0:1782241434.375085:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782241434.375092:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140054272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241434.375136:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140054272:12345-0@lo:400:kworker.0 Request processed in 44us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241434.375143:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782241434.375180:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140054272:0@lo:400:kworker.0 00010000:00010000:3.0:1782241434.376435:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241434.379073:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4c44c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:3637:x1868815140054144:12345-0@lo:400:kworker.0 Request processed in 5035us (5217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241434.379087:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1782241434.379496:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140054144:0@lo:400:kworker.0 00000100:00080000:0.0:1782241434.380364:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241434.380371:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241434.380373:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241434.380376:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241434.380428:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241434.380432:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241434.380435:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241434.380437:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782241434.382414:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140054656:0@lo:400:kworker.0 00000100:00100000:0.0:1782241434.382611:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140054528:0@lo:400:kworker.0 00000100:00100000:0.0:1782241434.382664:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241434.382735:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241434.382772:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241434.382779:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140054784:0@lo:400:kworker.0 00000100:00100000:2.0:1782241434.382803:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241434.382835:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140054656 00000100:00100000:2.0:1782241434.382848:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140054656 00000100:00100000:2.0:1782241434.382891:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140054784 00000100:00100000:2.0:1782241434.382894:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140054784 00000100:00100000:2.0:1782241434.382920:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782241434.382928:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140054656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241434.382980:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140054656:12345-0@lo:400:kworker.0 Request processed in 52us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241434.382987:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782241434.383002:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782241434.383022:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140054784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241434.383058:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140054784:12345-0@lo:400:kworker.0 Request processed in 50us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241434.383064:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1782241434.383083:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782241434.383107:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7f684a80 x1868815140054784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241434.383120:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140054784:0@lo:400:kworker.0 00010000:00080000:2.0:1782241434.383129:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7f687800 x1868815140054656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241434.383137:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140054656:0@lo:400:kworker.0 00000100:00100000:3.0:1782241434.387742:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140054400:0@lo:400:kworker.0 00000100:00100000:3.0:1782241434.387843:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241434.388374:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140054912:0@lo:400:kworker.0 00000100:00100000:3.0:1782241434.388403:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241434.388459:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140054400 00000100:00100000:3.0:1782241434.388468:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140054400 00000100:00100000:3.0:1782241434.388517:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140054912 00000100:00100000:3.0:1782241434.388520:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140054912 00000100:00100000:3.0:1782241434.388547:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782241434.388555:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140054400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241434.388613:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140054400:12345-0@lo:400:kworker.0 Request processed in 58us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241434.388621:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782241434.389163:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782241434.389180:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140054912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241434.389218:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140054912:12345-0@lo:400:kworker.0 Request processed in 40us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241434.389225:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1782241434.389251:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1782241434.389970:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7f685f80 x1868815140054400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241434.389986:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140054400:0@lo:400:kworker.0 00010000:00080000:3.0:1782241434.390018:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7f686680 x1868815140054912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241434.390028:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140054912:0@lo:400:kworker.0 00000100:00100000:0.0:1782241434.391042:0:18102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140054528 00000100:00100000:0.0:1782241434.391051:0:18102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140054528 00000100:00100000:0.0:1782241434.391099:0:18102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782241434.391108:0:18102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140054528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241434.391196:0:18102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140054528:12345-0@lo:400:kworker.0 Request processed in 89us (8532us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241434.391203:0:18102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782241434.391294:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140054528:0@lo:400:kworker.0 00000100:00100000:2.0:1782241435.343129:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241420/real 1782241420] req@ffff890e43f33480 x1868815140047360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241435 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241435.343161:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e43f33480 x1868815140047360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241435 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241435.343478:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241420/real 1782241420] req@ffff890e43f32a00 x1868815140047488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241435 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241435.343523:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e43f32a00 x1868815140047488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241435 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782241435.343544:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7c69c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782241435.343572:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1782241435.343576:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140047360:0@lo:8:kworker.0 00000100:00080000:2.0:1782241435.343582:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d469bc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782241435.343588:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1782241435.343591:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140047488:0@lo:8:kworker.0 00000100:00100000:3.0:1782241435.345445:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241435.345465:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140055040:0@lo:400:kworker.0 00000100:00100000:3.0:1782241435.345541:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241435.345598:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140055040 00000100:00100000:3.0:1782241435.345605:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140055040 00000100:00100000:3.0:1782241435.345650:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1782241435.345659:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4c44c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:3639:x1868815140055040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241435.345711:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4c44c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:3639:x1868815140055040:12345-0@lo:400:kworker.0 Request processed in 53us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241435.345719:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1782241435.345784:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140055040:0@lo:400:kworker.0 00000100:00080000:3.0:1782241435.345817:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241435.345821:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782241435.345834:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241435.345837:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782241435.345859:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241435.345862:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1782241435.345865:0:468:0:(import.c:65:import_set_state_nolock()) ffff890e7c69c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782241435.345870:0:468:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 483 00000100:00080000:3.0:1782241435.345873:0:468:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1782241435.345878:0:468:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff890e7c69c800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241435.345886:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140055424:0@lo:400:kworker.0 00000100:00100000:3.0:1782241435.345914:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241435.345956:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48135180 x1868815140055552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782241435.345970:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782241435.345972:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1782241435.345974:0:468:0:(import.c:65:import_set_state_nolock()) ffff890d469bc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782241435.345977:0:468:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 483 00000100:00080000:3.0:1782241435.345979:0:468:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1782241435.345982:0:468:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff890d469bc000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:3.0:1782241435.346008:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d47b4f480 x1868815140055680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782241435.346034:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241435.346042:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815140055808:0@lo:400:kworker.0 00000100:00100000:2.0:1782241435.346059:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140055168:0@lo:400:kworker.0 00000100:00100000:3.0:1782241435.346071:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241435.346100:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241435.346102:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140055808 00000100:00100000:3.0:1782241435.346113:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140055808 00000100:00100000:2.0:1782241435.346128:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241435.346136:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140055296:0@lo:400:kworker.0 00000100:00100000:3.0:1782241435.346146:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782241435.346154:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815140055808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241435.346163:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241435.346204:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815140055808:12345-0@lo:400:kworker.0 Request processed in 51us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241435.346208:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140055552:0@lo:8:kworker.0 00000100:00100000:3.0:1782241435.346213:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782241435.346231:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140055296 00000100:00100000:3.0:1782241435.346234:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140055296 00000100:00100000:2.0:1782241435.346248:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241435.346252:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782241435.346260:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140055296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241435.346277:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140055680:0@lo:8:kworker.0 00000100:00100000:3.0:1782241435.346296:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140055296:12345-0@lo:400:kworker.0 Request processed in 36us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241435.346302:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782241435.346313:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1782241435.346337:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d47b4e300 x1868815140055808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241435.346348:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815140055808:0@lo:400:kworker.0 00000100:00100000:2.0:1782241435.346348:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140055424 00000100:00100000:2.0:1782241435.346353:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140055424 00000100:00100000:2.0:1782241435.346382:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140055168 00000100:00100000:2.0:1782241435.346386:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140055168 00000100:00100000:2.0:1782241435.346405:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782241435.346411:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140055424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241435.346422:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140055936:0@lo:400:kworker.0 00000100:00100000:2.0:1782241435.346458:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140055424:12345-0@lo:400:kworker.0 Request processed in 44us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241435.346459:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241435.346473:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1782241435.346489:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d48136a00 x1868815140055296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241435.346492:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782241435.346502:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140055168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241435.346505:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140055296:0@lo:400:kworker.0 00000100:00100000:3.0:1782241435.346520:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241435.346526:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140056064:0@lo:400:kworker.0 00000100:00100000:2.0:1782241435.346539:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140055168:12345-0@lo:400:kworker.0 Request processed in 37us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241435.346546:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782241435.346560:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241435.346585:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140055424:0@lo:400:kworker.0 00000100:00100000:3.0:1782241435.346591:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140055168:0@lo:400:kworker.0 00000100:00100000:3.0:1782241435.346623:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140055936 00000100:00100000:3.0:1782241435.346626:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140055936 00000100:00100000:3.0:1782241435.346643:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140056064 00000100:00100000:3.0:1782241435.346645:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140056064 00000100:00100000:3.0:1782241435.346657:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782241435.346663:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140055936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241435.346720:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140055936:12345-0@lo:400:kworker.0 Request processed in 56us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241435.346726:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782241435.346741:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782241435.346749:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140056064:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1782241435.346752:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d47b4e300 x1868815140055936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241435.346783:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140055936:0@lo:400:kworker.0 00000100:00100000:3.0:1782241435.346812:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140056064:12345-0@lo:400:kworker.0 Request processed in 64us (254us total) trans 0 rc 0/0 00010000:00080000:2.0:1782241435.346819:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d47b4ea00 x1868815140056064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241435.346822:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782241435.346835:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140056064:0@lo:400:kworker.0 00000100:00100000:1.0:1782241435.347047:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140055552 00000100:00100000:1.0:1782241435.347053:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140055552 00000100:00100000:1.0:1782241435.347081:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140055680 00000100:00100000:1.0:1782241435.347085:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140055680 00000100:00100000:1.0:1782241435.347098:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241435.347102:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1868815140055552:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1782241435.347126:0:18554:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:1.0:1782241435.347166:0:18554:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e1aab2 00002000:00100000:1.0:1782241435.347178:0:18554:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff890e42fa7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1782241435.347182:0:18554:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1782241435.347185:0:18554:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782241435.347345:0:18554:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1782241435.347368:0:18554:0:(import.c:65:import_set_state_nolock()) ffff890d47b79800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241435.347420:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1868815140055552:12345-0@lo:8:kworker.0 Request processed in 316us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241435.347427:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241435.347439:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241435.347444:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1868815140055680:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1782241435.347454:0:18554:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1782241435.347732:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d48135180 x1868815140055552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782241455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241435.347742:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782241435.347748:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1782241435.347814:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782241435.347821:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1782241435.347823:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7c69c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782241435.347881:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782241435.347887:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140055552:0@lo:8:kworker.0 00000004:00080000:0.0:1782241435.348360:0:17788:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782241435.348436:0:17788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 498606678608ns, next at 0ns, rc = 0 00080000:00080000:0.0:1782241435.348443:0:17788:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1782241435.348621:0:17789:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1782241435.348645:0:17789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17789:1868815140056320:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1782241435.348690:0:17789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241435.348711:0:17789:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782241435.348918:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140056192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782241435.348954:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241435.354262:0:18555:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1782241435.354279:0:18555:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1782241435.354399:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140056320 00000100:00100000:0.0:1782241435.354408:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140056320 00000100:00100000:0.0:1782241435.354543:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782241435.354555:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17789:x1868815140056320:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:3.0:1782241435.363873:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241435.363885:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140056192 00000100:00100000:2.0:1782241435.363913:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140056192 00000100:00100000:2.0:1782241435.363980:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782241435.364002:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1868815140056192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782241435.364037:0:18557:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1782241435.365170:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1868815140056192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1177us (16210us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241435.365182:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1782241435.365238:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d469bc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782241435.365244:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782241435.365248:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140055680:0@lo:8:kworker.0 00010000:00080000:2.0:1782241435.365289:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d47b4f800 x1868815140056192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241435.365307:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140056192:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1782241435.366248:0:17780:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1782241435.367644:0:19173:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1782241435.367652:0:19173:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1782241435.367740:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17789:x1868815140056320:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13183us (19046us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241435.367751:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782241435.367822:0:17789:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d47b4d500 x1868815140056320/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782241451 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241435.367837:0:17789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17789:1868815140056320:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1782241435.367858:0:17789:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1782241435.367906:0:17789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17789:1868815140056448:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1782241435.367943:0:17789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241435.367967:0:17789:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df56cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241435.367984:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140056448 00000100:00100000:0.0:1782241435.368003:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140056448 00000100:00100000:0.0:1782241435.368038:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782241435.368046:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17789:x1868815140056448:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1782241435.368073:0:18555:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1782241435.368106:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17789:x1868815140056448:12345-0@lo:5:osp-pre-0-1.0 Request processed in 60us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241435.368111:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782241435.368135:0:17789:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7f686680 x1868815140056448/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782241451 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241435.368144:0:17789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17789:1868815140056448:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1782241435.368152:0:17789:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1782241435.368187:0:17789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17789:1868815140056576:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1782241435.368208:0:17789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241435.368221:0:17789:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df56cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241435.368230:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140056576 00000100:00100000:0.0:1782241435.368233:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140056576 00000100:00100000:0.0:1782241435.368249:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782241435.368255:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17789:x1868815140056576:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1782241435.368277:0:18555:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1782241435.372552:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1868815140055680:12345-0@lo:8:kworker.0 Request processed in 25094us (26227us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782241435.372567:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1782241435.400869:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782241435.406182:0:18550:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1782241435.406200:0:18550:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1782241435.406452:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17789:x1868815140056576:12345-0@lo:5:osp-pre-0-1.0 Request processed in 38192us (38236us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1782241435.406473:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1782241435.406791:0:17789:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7f686680 x1868815140056576/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782241451 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241435.406808:0:17789:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1782241435.406815:0:17789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17789:1868815140056576:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1782241435.406835:0:17789:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1782241435.406903:0:17789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17789:1868815140056704:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1782241435.406944:0:17789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241435.406976:0:17789:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67fff180 going to sleep for 11 seconds 00000100:00100000:3.0:1782241435.407044:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140056704 00000100:00100000:3.0:1782241435.407051:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140056704 00000100:00100000:3.0:1782241435.407096:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782241435.407106:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17789:x1868815140056704:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1782241435.407179:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17789:x1868815140056704:12345-0@lo:900:osp-pre-0-1.0 Request processed in 72us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241435.407196:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782241435.407383:0:17789:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d45a49880 x1868815140056704/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782241451 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241435.407400:0:17789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17789:1868815140056704:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1782241435.911096:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241435.911130:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140056960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241435.911208:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241435.912044:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140056832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241435.912096:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241435.912159:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140056960 00000100:00100000:2.0:1782241435.912167:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140056960 00000100:00100000:2.0:1782241435.912204:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140056832 00000100:00100000:2.0:1782241435.912208:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140056832 00000100:00100000:2.0:1782241435.912224:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782241435.912232:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140056960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782241435.912266:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1782241435.912305:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782241435.912319:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140056960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241435.912319:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140056832:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241435.912333:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00000024:1.0:1782241435.912347:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782241435.912379:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140056960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241435.912394:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140056832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241435.912403:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782241435.912440:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140056832:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782241436.422226:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241437.444864:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241438.468897:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782241438.789459:0:17085:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1782241439.222566:0:19367:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782241439.222570:0:19367:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1782241439.222572:0:19367:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1782241439.222681:0:19367:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff890e436de000 00000020:01000004:2.0:1782241439.222696:0:19367:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1782241439.222710:0:19367:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1782241439.222724:0:19367:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff890e43634d40) 00000020:00000080:2.0:1782241439.222753:0:19367:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1782241439.282644:0:19367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1782241439.284569:0:19367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1782241439.284805:0:19367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1782241439.287322:0:19367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1782241439.289342:0:19367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1782241439.289828:0:19367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1782241439.290111:0:19367:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1782241439.294457:0:19367:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1782241439.294695:0:19367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1782241439.294711:0:19367:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782241439.294724:0:19367:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc9959f2fb1e1aac0 00000020:01000004:1.0:1782241439.294731:0:19367:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1782241439.294754:0:19367:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.158@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782241439.294789:0:19367:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782241439.294795:0:19367:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1782241439.294826:0:19367:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1782241439.294830:0:19367:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.158@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1782241439.309938:0:19367:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.158@tcp ctxt 0 is initialized 00000020:01000004:1.0:1782241439.309981:0:19367:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.158@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1782241439.309987:0:19367:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1782241439.309988:0:19367:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782241439.309990:0:19367:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782241439.309991:0:19367:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782241439.309992:0:19367:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782241439.309993:0:19367:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782241439.309994:0:19367:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782241439.309996:0:19367:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782241439.309998:0:19367:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782241439.310001:0:19367:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1782241439.310003:0:19367:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782241439.310005:0:19367:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782241439.310006:0:19367:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782241439.310007:0:19367:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782241439.310008:0:19367:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782241439.310009:0:19367:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782241439.310011:0:19367:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782241439.310012:0:19367:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782241439.310013:0:19367:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782241439.310042:0:19367:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1782241439.310065:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140057088:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1782241439.310393:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241439.310455:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df56900 going to sleep for 11 seconds 00000100:00100000:0.0:1782241439.310523:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140057088 00000100:00100000:0.0:1782241439.310530:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140057088 00000100:00100000:0.0:1782241439.310584:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782241439.310593:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4c44e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:19367:x1868815140057088:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782241439.310625:0:17042:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1782241439.310628:0:17042:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1782241439.310632:0:17042:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1782241439.311257:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4c44e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:19367:x1868815140057088:12345-0@lo:253:mount.lustre.0 Request processed in 662us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241439.311267:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782241439.311360:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140057088:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782241439.311371:0:19367:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1782241439.311373:0:19367:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782241439.311374:0:19367:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782241439.311375:0:19367:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782241439.311376:0:19367:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782241439.311377:0:19367:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782241439.311378:0:19367:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782241439.311379:0:19367:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782241439.311381:0:19367:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782241439.311382:0:19367:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782241439.311402:0:19367:0:(tgt_mount.c:101:server_register_mount()) register mount ffff890e436de000 from lustre-OST0001 10000000:01000000:1.0:1782241439.311445:0:19367:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1782241439.311448:0:19367:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1782241439.311457:0:19367:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff890d4691cd40 local copy 00010000:00010000:1.0:1782241439.311467:0:19367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7e1 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241439.311562:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140057216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241439.311592:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241439.311660:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480c1480 going to sleep for 11 seconds 00000100:00100000:3.0:1782241439.311997:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140057216 00000100:00100000:3.0:1782241439.312003:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140057216 00000100:00100000:3.0:1782241439.312074:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782241439.312083:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4c44e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:19367:x1868815140057216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241439.312542:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140057216:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1782241439.312559:0:19367:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1782241439.312584:0:19367:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782241439.312591:0:19367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7e1 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.312600:0:19367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b861a00/0xc9959f2fb1e1a7da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1a7e1 expref: -99 pid: 17026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241439.312630:0:19367:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff890e436de000 10000000:01000000:2.0:1782241439.312635:0:19367:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782241439.312640:0:19367:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1782241439.312643:0:19367:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782241439.312647:0:19367:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1782241439.312650:0:19367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1782241439.312673:0:19367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.312681:0:19367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.312707:0:19367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241439.312723:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140057344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782241439.312776:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241439.312969:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4c44e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:19367:x1868815140057216:12345-0@lo:501:mount.lustre.0 Request processed in 887us (1376us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782241439.312978:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782241439.313087:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e43748a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782241439.313292:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140057344 00000100:00100000:3.0:1782241439.313298:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140057344 00000100:00100000:3.0:1782241439.313320:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782241439.313326:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:19367:x1868815140057344:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782241439.313337:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241439.313351:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e1aace lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1aac7 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241439.313373:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e1aace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aac7 expref: 22 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241439.313383:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164c800/0xc9959f2fb1e1aace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aac7 expref: 22 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241439.313393:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c800, rc 0) 00000100:00100000:3.0:1782241439.313445:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:19367:x1868815140057344:12345-0@lo:101:mount.lustre.0 Request processed in 119us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241439.313461:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782241439.313689:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140057344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782241439.313703:0:19367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aace expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.313712:0:19367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1aace expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782241439.319864:0:19367:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1782241439.321025:0:19367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782241439.325353:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1782241439.325406:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1782241439.325659:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1782241439.325679:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1782241439.325692:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1782241439.325704:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1782241439.325728:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1782241439.325733:0:19367:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1782241439.325880:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140057472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241439.325965:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241439.326070:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782241439.326731:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140057472 00000100:00100000:0.0:1782241439.326740:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140057472 00000100:00100000:1.0:1782241439.327033:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782241439.327044:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:19367:x1868815140057472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241439.327247:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:19367:x1868815140057472:12345-0@lo:501:mount.lustre.0 Request processed in 204us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241439.327255:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782241439.327346:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140057472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241439.327392:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140057600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782241439.327457:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241439.328228:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47ac1240 going to sleep for 11 seconds 00000100:00100000:3.0:1782241439.328510:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140057600 00000100:00100000:3.0:1782241439.328518:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140057600 00000100:00100000:3.0:1782241439.328551:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782241439.328559:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:19367:x1868815140057600:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241439.329437:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:19367:x1868815140057600:12345-0@lo:503:mount.lustre.0 Request processed in 876us (1976us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241439.329447:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782241439.329617:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140057600:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782241439.330108:0:19367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782241439.330334:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140057728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782241439.330386:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241439.330413:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47ac1240 going to sleep for 11 seconds 00000100:00100000:3.0:1782241439.330549:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140057728 00000100:00100000:3.0:1782241439.330556:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140057728 00000100:00100000:3.0:1782241439.330598:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782241439.330606:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:19367:x1868815140057728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241439.331319:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:19367:x1868815140057728:12345-0@lo:502:mount.lustre.0 Request processed in 711us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241439.331328:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782241439.331567:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140057728:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782241439.331880:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1782241439.331919:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1782241439.331937:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1782241439.331949:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1782241439.331963:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1782241439.331979:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1782241439.331993:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1782241439.332005:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1782241439.332018:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1782241439.332049:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140057856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782241439.332168:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241439.332320:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df56900 going to sleep for 11 seconds 00000100:00100000:3.0:1782241439.332372:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140057856 00000100:00100000:3.0:1782241439.332395:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140057856 00000100:00100000:3.0:1782241439.332620:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782241439.332630:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:19367:x1868815140057856:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241439.332784:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:19367:x1868815140057856:12345-0@lo:502:mount.lustre.0 Request processed in 156us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241439.332792:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782241439.336823:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140057856:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782241439.336971:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1782241439.336987:0:19367:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1782241439.338958:0:19371:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782241439.338969:0:19371:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1782241439.338975:0:19371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782241439.338978:0:19371:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1782241439.338985:0:19371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782241439.339000:0:19371:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff890e43630000) 00000020:00000080:2.0:1782241439.339027:0:19371:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782241439.339033:0:19371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782241439.339128:0:19371:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e436de000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1782241439.339137:0:19371:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782241439.339143:0:19371:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc9959f2fb1e1aadc 00010000:00010000:3.0:1782241439.347339:0:19371:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1782241439.347990:0:19371:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1782241439.352473:0:19371:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1782241439.356006:0:19371:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1782241439.356020:0:19371:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241439.356027:0:19371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241439.356029:0:19371:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1782241439.356033:0:19371:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241439.356037:0:19371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241439.356039:0:19371:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782241439.356042:0:19371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782241439.356045:0:19371:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1782241439.356047:0:19371:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241439.356049:0:19371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241439.356051:0:19371:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1782241439.356053:0:19371:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782241439.356056:0:19371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241439.356057:0:19371:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782241439.356060:0:19371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1782241439.356104:0:19371:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782241439.356108:0:19371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782241439.356109:0:19371:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782241439.356113:0:19371:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1782241439.358547:0:19367:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1782241439.358588:0:19367:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1782241439.358615:0:19367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aace expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241439.358628:0:19367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e4b861c00/0xc9959f2fb1e1aac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aace expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241439.358636:0:19367:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e436de000 from 1 10000000:01000000:1.0:1782241439.358638:0:19367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782241439.358678:0:19367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eba00/0xc9959f2fb1e1aae3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241439.358693:0:19367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e779eba00/0xc9959f2fb1e1aae3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241439.358706:0:19367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e779eba00/0xc9959f2fb1e1aae3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241439.358731:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140057984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782241439.358830:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241439.358867:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47ac1240 going to sleep for 11 seconds 00000100:00100000:0.0:1782241439.359272:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140057984 00000100:00100000:0.0:1782241439.359281:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140057984 00000100:00100000:0.0:1782241439.359335:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782241439.359344:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:19367:x1868815140057984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241439.359357:0:17042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241439.359370:0:17042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e1aaea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1aae3 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241439.359400:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e1aaea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aae3 expref: 23 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241439.359410:0:17042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e1aaea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aae3 expref: 23 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241439.360318:0:17042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1e00, rc 0) 00000100:00100000:0.0:1782241439.360396:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:19367:x1868815140057984:12345-0@lo:101:mount.lustre.0 Request processed in 1051us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241439.360404:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782241439.360663:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140057984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241439.360683:0:19367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e779eba00/0xc9959f2fb1e1aae3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aaea expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241439.360693:0:19367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e779eba00/0xc9959f2fb1e1aae3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1aaea expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782241439.366676:0:19367:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1782241439.367030:0:19367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782241439.367621:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1782241439.367655:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1782241439.367671:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1782241439.367676:0:19367:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1782241439.367749:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e47aeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140058112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782241439.367835:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241439.367947:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48527300 going to sleep for 11 seconds 00000100:00100000:1.0:1782241439.376103:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140058112 00000100:00100000:1.0:1782241439.376117:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140058112 00000100:00100000:3.0:1782241439.376921:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782241439.376935:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:19367:x1868815140058112:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782241439.377277:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:19367:x1868815140058112:12345-0@lo:501:mount.lustre.0 Request processed in 344us (9439us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241439.377285:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782241439.378017:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e47aeb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140058112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241439.378072:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140058240:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782241439.378140:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241439.378185:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48d87000 going to sleep for 11 seconds 00000100:00100000:1.0:1782241439.378353:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140058240 00000100:00100000:1.0:1782241439.378360:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140058240 00000100:00100000:1.0:1782241439.378402:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782241439.378410:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:19367:x1868815140058240:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782241439.378529:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:19367:x1868815140058240:12345-0@lo:503:mount.lustre.0 Request processed in 119us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241439.378536:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782241439.378799:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140058240:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782241439.379378:0:19367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782241439.379660:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140058368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241439.379716:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241439.379754:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48d87000 going to sleep for 11 seconds 00000100:00100000:3.0:1782241439.379839:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140058368 00000100:00100000:3.0:1782241439.379846:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140058368 00000100:00100000:3.0:1782241439.379885:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782241439.379892:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:19367:x1868815140058368:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241439.379999:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:19367:x1868815140058368:12345-0@lo:502:mount.lustre.0 Request processed in 106us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241439.380007:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782241439.380280:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140058368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782241439.380684:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1782241439.380714:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1782241439.380727:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1782241439.380741:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1782241439.380897:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1782241439.380934:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1782241439.380948:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1782241439.380961:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1782241439.380973:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1782241439.380985:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1782241439.380997:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1782241439.381024:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140058496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241439.381073:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241439.381287:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48d87000 going to sleep for 11 seconds 00000100:00100000:3.0:1782241439.381387:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140058496 00000100:00100000:3.0:1782241439.381393:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140058496 00000100:00100000:3.0:1782241439.381613:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782241439.381624:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:19367:x1868815140058496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782241439.381724:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:19367:x1868815140058496:12345-0@lo:502:mount.lustre.0 Request processed in 102us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241439.381732:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782241439.381904:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140058496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782241439.381988:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1782241439.382000:0:19367:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1782241439.383025:0:19375:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241439.383036:0:19375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241439.383039:0:19375:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782241439.383046:0:19375:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890e436de000 00000020:00000080:1.0:1782241439.383049:0:19375:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782241439.383057:0:19375:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241439.383059:0:19375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241439.383061:0:19375:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1782241439.383063:0:19375:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241439.383065:0:19375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241439.383067:0:19375:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782241439.383070:0:19375:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff890e436de000 00000020:00000080:1.0:1782241439.383072:0:19375:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782241439.383144:0:19375:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241439.383148:0:19375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241439.383149:0:19375:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1782241439.383151:0:19375:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241439.383154:0:19375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241439.383155:0:19375:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782241439.383158:0:19375:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890e436de000 00000020:00000080:1.0:1782241439.383161:0:19375:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782241439.386371:0:19375:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241439.386382:0:19375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241439.386383:0:19375:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782241439.386388:0:19375:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782241439.386392:0:19375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241439.386393:0:19375:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1782241439.386397:0:19375:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff890e436de000 00000020:00000080:1.0:1782241439.386399:0:19375:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782241439.386457:0:19375:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782241439.386467:0:19375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782241439.386469:0:19375:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1782241439.386472:0:19375:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1782241439.387836:0:19367:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1782241439.387873:0:19367:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782241439.387896:0:19367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eba00/0xc9959f2fb1e1aae3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aaea expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241439.387922:0:19367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e779eba00/0xc9959f2fb1e1aae3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aaea expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782241439.387980:0:19367:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782241439.387983:0:19367:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff890e436de000 10000000:01000000:0.0:1782241439.387987:0:19367:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff890e436de000 10000000:01000000:0.0:1782241439.387990:0:19367:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782241439.387996:0:19367:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff890e436de000 from 1 10000000:01000000:0.0:1782241439.387998:0:19367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782241439.388034:0:19367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241439.388042:0:19367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241439.388053:0:19367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241439.388102:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140058624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782241439.388344:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241439.388387:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48d870c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241439.388474:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140058624 00000100:00100000:1.0:1782241439.388482:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140058624 00000100:00100000:1.0:1782241439.388650:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782241439.388662:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:19367:x1868815140058624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782241439.388676:0:17042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241439.388689:0:17042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779ea000/0xc9959f2fb1e1aaf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1aaf1 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241439.388712:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779ea000/0xc9959f2fb1e1aaf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aaf1 expref: 24 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241439.388722:0:17042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779ea000/0xc9959f2fb1e1aaf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aaf1 expref: 24 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241439.388731:0:17042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea000, rc 0) 00000100:00100000:1.0:1782241439.388792:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:19367:x1868815140058624:12345-0@lo:101:mount.lustre.0 Request processed in 132us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241439.388798:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782241439.389292:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140058624:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782241439.389307:0:19367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aaf8 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241439.389316:0:19367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1aaf8 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782241439.394269:0:19367:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1782241439.396710:0:19367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782241439.396982:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1782241439.397010:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1782241439.397023:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1782241439.397036:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1782241439.397048:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1782241439.397061:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1782241439.397073:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1782241439.397085:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1782241439.400404:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1782241439.401527:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1782241439.401554:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1782241439.401567:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1782241439.401596:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1782241439.401610:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1782241439.401622:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1782241439.401633:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1782241439.401646:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1782241439.401668:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1782241439.401680:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1782241439.401692:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1782241439.401703:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1782241439.401715:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1782241439.401726:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1782241439.401738:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1782241439.401750:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1782241439.401778:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1782241439.401792:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1782241439.401803:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1782241439.401830:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1782241439.401842:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1782241439.401852:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1782241439.401863:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1782241439.401875:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1782241439.401886:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1782241439.401899:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1782241439.401926:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1782241439.401940:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1782241439.401953:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1782241439.401967:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1782241439.401980:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1782241439.401993:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1782241439.402006:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1782241439.402019:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1782241439.402033:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1782241439.402061:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1782241439.402078:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1782241439.402105:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1782241439.402111:0:19367:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1782241439.402241:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140058752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241439.402318:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241439.402369:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48d87000 going to sleep for 11 seconds 00000100:00100000:1.0:1782241439.402562:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140058752 00000100:00100000:1.0:1782241439.402571:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140058752 00000100:00100000:1.0:1782241439.402616:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782241439.402625:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:19367:x1868815140058752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782241439.402752:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:19367:x1868815140058752:12345-0@lo:501:mount.lustre.0 Request processed in 128us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241439.402783:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782241439.407300:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140058752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782241439.407362:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140058880:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782241439.407429:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241439.407468:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48d87000 going to sleep for 11 seconds 00000100:00100000:3.0:1782241439.407692:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140058880 00000100:00100000:3.0:1782241439.407700:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140058880 00000100:00100000:3.0:1782241439.408290:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782241439.408302:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:19367:x1868815140058880:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782241439.408486:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:19367:x1868815140058880:12345-0@lo:503:mount.lustre.0 Request processed in 186us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241439.408494:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782241439.408844:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140058880:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782241439.409405:0:19367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782241439.409888:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140059008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241439.409966:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241439.410012:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140059008 00000100:00100000:0.0:1782241439.410018:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140059008 00000100:00100000:0.0:1782241439.410094:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782241439.410103:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:19367:x1868815140059008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241439.410210:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:19367:x1868815140059008:12345-0@lo:502:mount.lustre.0 Request processed in 107us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241439.410217:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782241439.413651:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48d870c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241439.413708:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140059008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782241439.414003:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1782241439.414040:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1782241439.414058:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1782241439.414073:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1782241439.414087:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1782241439.414101:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1782241439.414116:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1782241439.414130:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1782241439.414143:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1782241439.414156:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1782241439.414184:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1782241439.414200:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1782241439.414229:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1782241439.414243:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1782241439.414257:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1782241439.414269:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1782241439.414280:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1782241439.414292:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1782241439.414305:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1782241439.414317:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1782241439.414329:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1782241439.414342:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1782241439.414353:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1782241439.414367:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1782241439.414380:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1782241439.414392:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1782241439.414402:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1782241439.414413:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1782241439.414623:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1782241439.414639:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1782241439.414650:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1782241439.414675:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1782241439.414690:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1782241439.414703:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1782241439.414714:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1782241439.414725:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1782241439.414736:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1782241439.414748:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1782241439.414783:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1782241439.414797:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1782241439.414808:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1782241439.414819:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1782241439.414829:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1782241439.414841:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1782241439.414863:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1782241439.414874:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1782241439.414885:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1782241439.414896:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1782241439.414961:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140059136:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782241439.415036:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241439.415084:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d477cb000 going to sleep for 11 seconds 00000100:00100000:0.0:1782241439.415194:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140059136 00000100:00100000:0.0:1782241439.415200:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140059136 00000100:00100000:0.0:1782241439.415264:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782241439.415275:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e50599c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:19367:x1868815140059136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241439.415391:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e50599c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:19367:x1868815140059136:12345-0@lo:502:mount.lustre.0 Request processed in 118us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241439.415399:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782241439.415649:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140059136:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782241439.415866:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1782241439.415895:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1782241439.415939:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140059264:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782241439.415981:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241439.416012:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d477cb000 going to sleep for 11 seconds 00000100:00100000:0.0:1782241439.416084:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140059264 00000100:00100000:0.0:1782241439.416094:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140059264 00000100:00100000:0.0:1782241439.416119:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782241439.416127:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5059ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:19367:x1868815140059264:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782241439.416221:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5059ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:19367:x1868815140059264:12345-0@lo:502:mount.lustre.0 Request processed in 93us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241439.416228:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1782241439.416572:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140059264:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782241439.416616:0:19367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1782241439.416625:0:19367:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1782241439.418405:0:19380:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1782241439.419272:0:19380:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff890e503f4d40) 00000020:00000080:1.0:1782241439.419300:0:19380:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1782241439.420631:0:19380:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e436de000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782241439.420640:0:19380:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e436de000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782241439.420644:0:19380:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e436de000 3 00010000:00080000:1.0:1782241439.420680:0:19380:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890e7d6de800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241439.425797:0:19380:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1782241439.425895:0:19380:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1782241439.425949:0:19380:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782241439.425961:0:19380:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc9959f2fb1e1ab06 00000100:00080000:1.0:1782241439.425972:0:19380:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782241439.425979:0:19380:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff890e7d6de800 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241439.426015:0:19380:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a48e00 x1868815140059392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241439.426045:0:19380:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782241439.426131:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815140059392:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782241439.426199:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241439.426264:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140059392 00000100:00080000:0.0:1782241439.426264:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241439.426268:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782241439.426271:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140059392 00000100:00080000:0.0:1782241439.426271:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241439.426274:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782241439.426301:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1782241439.426303:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241439.426306:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:2.0:1782241439.426308:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1868815140059392:12345-0@lo:38:llog_process_th.0 00000100:00080000:0.0:1782241439.426309:0:8:0:(import.c:65:import_set_state_nolock()) ffff890d469bc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782241439.426313:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 498 00000100:00080000:0.0:1782241439.426316:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1782241439.426320:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff890d469bc000 using connection 192.168.204.158@tcp/0@lo 00010000:00080000:2.0:1782241439.426330:0:17049:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000100:00100000:0.0:1782241439.426332:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890e7f687100 x1868815140060032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1782241439.426371:0:17049:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc9959f2fb1e1ab0d 00000004:00100000:2.0:1782241439.426386:0:17049:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782241439.426415:0:17049:0:(import.c:65:import_set_state_nolock()) ffff890d47565000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241439.426458:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1868815140059392:12345-0@lo:38:llog_process_th.0 Request processed in 149us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241439.426465:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782241439.426615:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140059520:0@lo:400:kworker.0 00000100:00100000:0.0:1782241439.426648:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241439.426668:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140060160:0@lo:400:kworker.0 00000100:00100000:0.0:1782241439.426687:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241439.426704:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782241439.426709:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140059904:0@lo:400:kworker.0 00000100:00100000:0.0:1782241439.426738:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241439.426784:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140059648:0@lo:400:kworker.0 00000100:00100000:0.0:1782241439.426807:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241439.426822:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815140060288:0@lo:400:kworker.0 00000100:00100000:0.0:1782241439.426839:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241439.426854:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782241439.426859:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140059776:0@lo:400:kworker.0 00000100:00100000:0.0:1782241439.426877:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241439.426890:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140060416:0@lo:400:kworker.0 00000100:00100000:0.0:1782241439.426922:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241439.426943:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140060032:0@lo:8:kworker.0 00000100:00100000:0.0:1782241439.426968:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1782241439.426999:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d45a48e00 x1868815140059392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241439.427009:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782241439.427015:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1782241439.427021:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782241439.427025:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782241439.427027:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e7d6de800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782241439.427032:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1868815140059392:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782241439.427055:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140059520 00000100:00100000:0.0:1782241439.427058:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140059520 00000100:00100000:0.0:1782241439.427086:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140059776 00000100:00100000:0.0:1782241439.427089:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140059776 00000100:00100000:0.0:1782241439.427102:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782241439.427115:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140059520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241439.427157:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140059520:12345-0@lo:400:kworker.0 Request processed in 43us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241439.427163:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782241439.428813:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140060160 00000100:00100000:1.0:1782241439.428825:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140060160 00000100:00100000:1.0:1782241439.428890:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140059648 00000100:00100000:1.0:1782241439.428894:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140059648 00000100:00100000:1.0:1782241439.428921:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140060288 00000100:00100000:1.0:1782241439.428924:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140060288 00000100:00100000:1.0:1782241439.428954:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140060416 00000100:00100000:1.0:1782241439.428957:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140060416 00000100:00100000:1.0:1782241439.429002:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782241439.429011:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140060160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241439.429076:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140060160:12345-0@lo:400:kworker.0 Request processed in 67us (2387us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241439.429083:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782241439.429109:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782241439.429115:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140059648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241439.429157:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140059648:12345-0@lo:400:kworker.0 Request processed in 42us (2348us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241439.429163:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782241439.429189:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782241439.429197:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815140060288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241439.429227:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815140060288:12345-0@lo:400:kworker.0 Request processed in 31us (2386us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241439.429233:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782241439.429244:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782241439.429250:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140060416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241439.429275:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140060416:12345-0@lo:400:kworker.0 Request processed in 26us (2353us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241439.429281:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782241439.429305:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140059904 00000100:00100000:1.0:1782241439.429308:0:19173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140059904 00000100:00100000:1.0:1782241439.429334:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140060032 00000100:00100000:1.0:1782241439.429337:0:19173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140060032 00000100:00100000:1.0:1782241439.429352:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241439.429359:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140059904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241439.429391:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140059904:12345-0@lo:400:kworker.0 Request processed in 33us (2652us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241439.429399:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782241439.429410:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782241439.429428:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1868815140060032:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1782241439.429490:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1868815140060032:12345-0@lo:8:kworker.0 Request processed in 73us (2521us total) trans 0 rc -11/-11 00000100:00100000:1.0:1782241439.429673:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1782241439.430052:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782241439.430058:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782241439.430069:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241439.430589:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782241439.430602:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140059776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241439.430657:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140059776:12345-0@lo:400:kworker.0 Request processed in 60us (3778us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241439.430664:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1782241439.430715:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7f686680 x1868815140059904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241439.430728:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140059904:0@lo:400:kworker.0 00000100:00100000:0.0:1782241439.430743:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140059520:0@lo:400:kworker.0 00010000:00080000:0.0:1782241439.430777:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e43f32a00 x1868815140060160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241439.430786:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140060160:0@lo:400:kworker.0 00000100:00100000:0.0:1782241439.430827:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140059776:0@lo:400:kworker.0 00010000:00080000:0.0:1782241439.430840:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e43f33800 x1868815140060416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241439.430848:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140060416:0@lo:400:kworker.0 00010000:00080000:0.0:1782241439.430857:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e7f684a80 x1868815140059648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241439.430865:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140059648:0@lo:400:kworker.0 00010000:00080000:0.0:1782241439.430885:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890e43f33480 x1868815140060288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241439.430893:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815140060288:0@lo:400:kworker.0 00000100:00100000:0.0:1782241439.430935:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782241439.430943:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d469bc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782241439.430947:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782241439.430951:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140060032:0@lo:8:kworker.0 00000020:01000004:1.0:1782241439.432360:0:19380:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1782241439.432378:0:19380:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff890e503f19c0) 00000020:00000080:1.0:1782241439.432402:0:19380:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1782241439.432861:0:19380:0:(tgt_mount.c:153:server_get_mount()) get mount ffff890e436de000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782241439.432866:0:19380:0:(tgt_mount.c:187:server_put_mount()) put mount ffff890e436de000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782241439.432868:0:19380:0:(obd_mount.c:701:lustre_put_lsi()) put ffff890e436de000 3 00010000:00080000:1.0:1782241439.432898:0:19380:0:(ldlm_lib.c:102:import_set_conn()) imp ffff890e476e5000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.158@tcp at head 00010000:00010000:1.0:1782241439.437389:0:19380:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1782241439.437793:0:19380:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1782241439.437843:0:19380:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782241439.437861:0:19380:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc9959f2fb1e1ab1b 00000100:00080000:1.0:1782241439.437871:0:19380:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782241439.437877:0:19380:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff890e476e5000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241439.437926:0:19380:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d45a4b480 x1868815140060544/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241439.437959:0:19380:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1782241439.438056:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1868815140060544:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782241439.438122:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782241439.438251:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241439.438257:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782241439.438259:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782241439.438262:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1782241439.438615:0:19380:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1782241439.438802:0:19367:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1782241439.438844:0:19367:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782241439.438863:0:19367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aaf8 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241439.438873:0:19367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e778f0c00/0xc9959f2fb1e1aaf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1aaf8 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782241439.438931:0:19367:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782241439.438938:0:19367:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782241439.438939:0:19367:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782241439.438941:0:19367:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782241439.438942:0:19367:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782241439.438943:0:19367:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782241439.438945:0:19367:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782241439.438946:0:19367:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782241439.438947:0:19367:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782241439.438951:0:19367:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1782241439.438954:0:19367:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782241439.438955:0:19367:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782241439.438956:0:19367:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782241439.438956:0:19367:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782241439.438957:0:19367:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782241439.438959:0:19367:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782241439.438960:0:19367:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782241439.438960:0:19367:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782241439.438961:0:19367:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782241439.438979:0:19367:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1782241439.438992:0:19367:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140060672:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1782241439.439034:0:19367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241439.439066:0:19367:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d477cbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782241439.439086:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140060544 00000100:00100000:1.0:1782241439.439092:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140060544 00000100:00100000:1.0:1782241439.439123:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782241439.439130:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1868815140060544:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782241439.439154:0:17046:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000100:00100000:3.0:1782241439.439589:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140060672 00000100:00100000:3.0:1782241439.439594:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140060672 00000100:00100000:3.0:1782241439.439641:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782241439.439650:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5059a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:19367:x1868815140060672:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782241439.439674:0:17039:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1782241439.439690:0:17039:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:00000080:1.0:1782241439.440287:0:17046:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc9959f2fb1e1ab22 00000004:00100000:1.0:1782241439.440306:0:17046:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782241439.440347:0:17046:0:(import.c:65:import_set_state_nolock()) ffff890e67fe3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241439.440753:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1868815140060544:12345-0@lo:38:llog_process_th.0 Request processed in 1619us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241439.440778:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1782241439.442603:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff890d45a4b480 x1868815140060544/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782241449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241439.442620:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782241439.442630:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1782241439.442640:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782241439.442646:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1782241439.442649:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e476e5000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782241439.442656:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1868815140060544:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1782241439.453344:0:17039:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782241439.453369:0:17039:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1782241439.453511:0:17063:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782241439.453517:0:17063:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782241439.453538:0:17063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ab29 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241439.453558:0:17063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1aa9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aa96 expref: 24 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241439.453566:0:17063:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e1aaab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aaa4 expref: 24 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241439.453573:0:17063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ab29 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241439.453613:0:17063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e1aaab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1aaa4 expref: 24 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241439.453627:0:17063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e1aaab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aaa4 expref: 24 pid: 17039 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241439.453642:0:17063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1868815140060800:0@lo:104: 00000100:00100000:1.0:1782241439.453707:0:17063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782241439.453778:0:17063:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1aa9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1aa96 expref: 24 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241439.454836:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5059a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:19367:x1868815140060672:12345-0@lo:253:mount.lustre.0 Request processed in 15183us (15797us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241439.454849:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782241439.454936:0:19367:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:19367:1868815140060672:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1782241439.454950:0:19367:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1782241439.454953:0:19367:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782241439.454955:0:19367:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782241439.454957:0:19367:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782241439.454958:0:19367:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782241439.454959:0:19367:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782241439.454960:0:19367:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782241439.454961:0:19367:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782241439.454963:0:19367:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782241439.454965:0:19367:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782241439.454981:0:19367:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1782241439.455267:0:17063:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1aa9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aa96 expref: 24 pid: 17041 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241439.455286:0:17063:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1868815140060928:0@lo:104: 00000100:00100000:1.0:1782241439.455321:0:17063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241439.455343:0:17063:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d477cb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241439.455374:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140060800 00000100:00100000:1.0:1782241439.455380:0:17031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140060800 00000100:00100000:3.0:1782241439.455767:0:17030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140060928 00000100:00100000:3.0:1782241439.455773:0:17030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140060928 00000100:00100000:3.0:1782241439.455796:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782241439.455804:0:17030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+4:17063:x1868815140060800:12345-0@lo:104: 00010000:00010000:3.0:1782241439.455818:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4b860600/0xc9959f2fb1e1aaa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1aaab expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241439.455872:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782241439.455878:0:17030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+4:17063:x1868815140060800:12345-0@lo:104: Request processed in 75us (2172us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241439.455884:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782241439.455898:0:17030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782241439.455904:0:17030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+3:17063:x1868815140060928:12345-0@lo:104: 00010000:00010000:3.0:1782241439.455922:0:17030:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e1aa96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1aa9d expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241439.455963:0:17030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782241439.455968:0:17030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+3:17063:x1868815140060928:12345-0@lo:104: Request processed in 64us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241439.455974:0:17030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1782241439.456000:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241439.456006:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b860600/0xc9959f2fb1e1aaa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1aaab expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241439.456022:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860600 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241439.456026:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860600/0xc9959f2fb1e1aaa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1aaab expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241439.456033:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b860600/0xc9959f2fb1e1aaa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1aaab expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241439.456049:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860600/0xc9959f2fb1e1aaa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1aaab expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241439.456055:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241439.456090:0:17036:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4b860600/0xc9959f2fb1e1aaa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aaab expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241439.456097:0:17036:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241439.456114:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b860600/0xc9959f2fb1e1aaa4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aaab expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241439.456121:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b860600/0xc9959f2fb1e1aaa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aaab expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241439.456133:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241439.456136:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e1aa96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1aa9d expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241439.456141:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860000 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:3.0:1782241439.456144:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e1aa96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1aa9d expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241439.456161:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e1aa96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1aa9d expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782241439.456167:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e1aa96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1aa9d expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241439.456172:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782241439.456186:0:17036:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e1aa96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aa9d expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241439.456191:0:17036:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782241439.456197:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e1aa96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aa9d expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241439.456203:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b860000/0xc9959f2fb1e1aa96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aa9d expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241439.456215:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241439.456217:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241439.456219:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241439.456237:0:17063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1868815140060800:0@lo:104: 00000100:00100000:3.0:1782241439.456246:0:17063:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17063:1868815140060928:0@lo:104: 00010000:00010000:3.0:1782241439.456268:0:17063:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ab29 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241439.459436:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241439.464829:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140061056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782241439.464902:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241439.464961:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782241439.464967:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140061184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782241439.464989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241439.471794:0:17034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140061056 00000100:00100000:2.0:1782241439.471810:0:17034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140061056 00010000:00010000:2.0:1782241439.471864:0:17034:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e1aaab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aaa4 expref: 24 pid: 17039 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241439.471904:0:17034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140061184 00000100:00100000:2.0:1782241439.471920:0:17034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140061184 00010000:00010000:2.0:1782241439.471936:0:17034:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1aa9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aa96 expref: 25 pid: 17041 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241439.471971:0:17034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782241439.471980:0:17034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+25:3637:x1868815140061056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241439.471998:0:17034:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241439.472005:0:17034:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e1aaab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aaa4 expref: 25 pid: 17039 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.472018:0:17034:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e1aaab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aaa4 expref: 25 pid: 17039 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.472037:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e778f0000/0xc9959f2fb1e1aaab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1aaa4 expref: 25 pid: 17039 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.472052:0:17034:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241439.472127:0:17034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3637:x1868815140061056:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (7224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241439.472134:0:17034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782241439.472152:0:17034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782241439.472159:0:17034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:3637:x1868815140061184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241439.472166:0:17034:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241439.472171:0:17034:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1aa9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aa96 expref: 23 pid: 17041 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.472181:0:17034:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1aa9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aa96 expref: 23 pid: 17041 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.472191:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1aa9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1aa96 expref: 23 pid: 17041 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.472215:0:17034:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ab29 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.472224:0:17034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ab29 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782241439.472240:0:17034:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018724033s 00010000:00010000:2.0:1782241439.472245:0:17034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ab29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241439.472613:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140061056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241439.473204:0:17034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ab29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.473211:0:17034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ab29 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.473218:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ab29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.473225:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241439.473230:0:17034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ab29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.473241:0:17034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ab29 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.473965:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ab29 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241439.473983:0:17034:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241439.473987:0:17063:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ab29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241439.473998:0:17063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ab29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241439.474004:0:17063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ab29 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241439.474056:0:17034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:3637:x1868815140061184:12345-0@lo:103:ldlm_bl.0 Request processed in 1896us (9064us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241439.474066:0:17034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782241439.474071:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140061184:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1782241439.483746:0:19367:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1782241439.489393:0:19367:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1782241439.489404:0:19367:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1782241439.489457:0:19367:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782241439.489508:0:19367:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.158@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782241439.489531:0:19367:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1782241439.489551:0:19367:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1782241439.493018:0:19367:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782241439.493808:0:19367:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782241439.494643:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782241440.325077:0:19434:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782241440.325310:0:19434:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782241440.528177:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241440.530091:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140061312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241440.530162:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241440.530223:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140061312 00000100:00100000:1.0:1782241440.530231:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140061312 00000100:00100000:1.0:1782241440.530270:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782241440.530277:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140061312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782241440.530305:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1782241440.530345:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48203800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140061312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241440.530364:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782241440.530404:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d45a4b800 x1868815140061312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241440.530424:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140061312:0@lo:13:osp-pre-0-1.0 10000000:01000000:1.0:1782241440.709280:0:17044:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782241440.709288:0:17044:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d48032000 from 10 10000000:01000000:1.0:1782241440.709293:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782241440.709363:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241440.709375:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241440.709387:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241440.709413:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48200a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140061440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782241440.709482:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241440.709529:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d477cb180 going to sleep for 11 seconds 00000100:00100000:0.0:1782241440.709668:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140061440 00000100:00100000:0.0:1782241440.709675:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140061440 00000100:00100000:0.0:1782241440.709737:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782241440.709747:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5059a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:17044:x1868815140061440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241440.709789:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241440.709805:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e778f1200/0xc9959f2fb1e1ab37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1ab30 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241440.709829:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e778f1200/0xc9959f2fb1e1ab37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1ab30 expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241440.709839:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e778f1200/0xc9959f2fb1e1ab37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1ab30 expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241440.709865:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f1200, rc 0) 00000100:00100000:0.0:1782241440.709920:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5059a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:17044:x1868815140061440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241440.709928:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782241440.710044:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48200a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140061440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241440.710071:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ab37 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241440.710080:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1ab37 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241440.710132:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140061568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1782241440.710166:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241440.710194:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d474ad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241440.710301:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140061568 00000100:00100000:0.0:1782241440.710314:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140061568 00000100:00100000:0.0:1782241440.710343:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782241440.710350:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5059b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:17044:x1868815140061568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782241440.710363:0:17039:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782241440.710378:0:17039:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782241440.710381:0:17039:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1782241440.710444:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5059b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:17044:x1868815140061568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241440.710451:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782241440.710568:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140061568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1782241440.710617:0:17044:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782241440.710623:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ab37 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241440.710631:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e779ea200/0xc9959f2fb1e1ab30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ab37 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241440.710640:0:17044:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782241440.710641:0:17044:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff890d48284800 from 10 10000000:01000000:3.0:1782241440.710644:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782241440.710657:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241440.710673:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241440.710681:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241440.710692:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140061696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782241440.710714:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241440.710733:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d474ad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241440.710782:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140061696 00000100:00100000:0.0:1782241440.710786:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140061696 00000100:00100000:0.0:1782241440.710811:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782241440.710816:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5059b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:17044:x1868815140061696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241440.710823:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241440.710830:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e778f0a00/0xc9959f2fb1e1ab45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1ab3e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241440.710844:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e778f0a00/0xc9959f2fb1e1ab45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1ab3e expref: 24 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241440.710853:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e778f0a00/0xc9959f2fb1e1ab45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1ab3e expref: 24 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241440.710868:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e778f0a00, rc 0) 00000100:00100000:0.0:1782241440.710908:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5059b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:17044:x1868815140061696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241440.710914:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782241440.710940:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140061696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241440.710949:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ab45 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241440.710957:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1ab45 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241440.710989:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140061824:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782241440.711013:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241440.711028:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e503e60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241440.711037:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140061824 00000100:00100000:0.0:1782241440.711040:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140061824 00000100:00100000:0.0:1782241440.711054:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782241440.711059:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e50598850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:17044:x1868815140061824:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782241440.711077:0:17039:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782241440.711086:0:17039:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782241440.711088:0:17039:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1782241440.711138:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e50598850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:17044:x1868815140061824:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 78us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241440.711144:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782241440.711167:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140061824:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782241440.711204:0:17044:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782241440.711209:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ab45 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241440.711217:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e8164d400/0xc9959f2fb1e1ab3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ab45 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241441.034500:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241441.034523:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140061952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241441.034598:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241441.034645:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140061952 00000100:00100000:0.0:1782241441.034652:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140061952 00000100:00100000:0.0:1782241441.034697:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782241441.034705:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140061952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241441.034741:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782241441.034815:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140061952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241441.034822:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782241441.034867:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140061952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241441.035117:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140062080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241441.035144:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241441.035172:0:18102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140062080 00000100:00100000:0.0:1782241441.035176:0:18102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140062080 00000100:00100000:0.0:1782241441.035197:0:18102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782241441.035203:0:18102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140062080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241441.035224:0:18102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1782241441.035283:0:18102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140062080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241441.035290:0:18102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782241441.038849:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140062080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241441.477652:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241421/real 1782241421] req@ffff890e43f32300 x1868815140047872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241441 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241441.477686:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e43f32300 x1868815140047872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241441 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241441.477697:0:3636:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782241421/real 1782241421] req@ffff890e43f31500 x1868815140048000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241441 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241441.477708:0:3636:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff890e43f31500 x1868815140048000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782241441 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782241441.477727:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e77aae000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782241441.477781:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782241441.477785:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140047872:0@lo:8:kworker.0 00000100:00080000:3.0:1782241441.477791:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e67fa6000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782241441.477796:0:3636:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782241441.477799:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e43f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140048000:0@lo:8:kworker.0 00000100:00100000:3.0:1782241441.478138:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140062208:0@lo:400:kworker.0 00000100:00100000:3.0:1782241441.478211:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782241441.478295:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782241441.478300:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1782241441.478303:0:8:0:(import.c:65:import_set_state_nolock()) ffff890e77aae000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782241441.478308:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:1.0:1782241441.478312:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1782241441.478319:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff890e77aae000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241441.478341:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48201180 x1868815140062336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241441.478369:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782241441.478372:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782241441.478374:0:8:0:(import.c:65:import_set_state_nolock()) ffff890e67fa6000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782241441.478377:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:1.0:1782241441.478379:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1782241441.478383:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff890e67fa6000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241441.478395:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48200e00 x1868815140062464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782241441.478426:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782241441.478430:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782241441.478432:0:8:0:(import.c:65:import_set_state_nolock()) ffff890d469bc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782241441.478436:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff890d469bc000 using connection 192.168.204.158@tcp/0@lo 00000100:00100000:1.0:1782241441.478447:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff890d48202a00 x1868815140062848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782241441.478513:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48200000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140062976:0@lo:400:kworker.0 00000100:00100000:2.0:1782241441.478548:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241441.478590:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140062336:0@lo:8:kworker.0 00000100:00100000:2.0:1782241441.478615:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241441.478632:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48200e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140062464:0@lo:8:kworker.0 00000100:00100000:2.0:1782241441.478650:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241441.478665:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140062848:0@lo:8:kworker.0 00000100:00100000:2.0:1782241441.478684:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241441.480328:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140062208 00000100:00100000:0.0:1782241441.480342:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140062208 00000100:00100000:0.0:1782241441.480419:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1782241441.480429:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e50599050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3638:x1868815140062208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241441.480499:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e50599050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3638:x1868815140062208:12345-0@lo:400:kworker.0 Request processed in 72us (2288us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241441.480506:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1782241441.480547:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140062592:0@lo:400:kworker.0 00000100:00100000:0.0:1782241441.480578:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241441.480583:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140062208:0@lo:400:kworker.0 00000100:00100000:0.0:1782241441.480602:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241441.480608:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140062720:0@lo:400:kworker.0 00000100:00100000:3.0:1782241441.480613:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140062336 00000100:00100000:3.0:1782241441.480616:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140062336 00000100:00100000:0.0:1782241441.480630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241441.480636:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140062464 00000100:00100000:3.0:1782241441.480639:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140062464 00000100:00100000:3.0:1782241441.480646:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140062848 00000100:00100000:3.0:1782241441.480649:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140062848 00000100:00100000:0.0:1782241441.480652:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140062976 00000100:00100000:3.0:1782241441.480655:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140062720 00000100:00100000:0.0:1782241441.480655:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140062976 00000100:00100000:3.0:1782241441.480656:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140062720 00000100:00100000:0.0:1782241441.480677:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140062592 00000100:00100000:3.0:1782241441.480680:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782241441.480680:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140062592 00000100:00100000:3.0:1782241441.480685:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140062720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241441.480691:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782241441.480712:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140062976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241441.480724:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140062720:12345-0@lo:400:kworker.0 Request processed in 39us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241441.480730:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782241441.480743:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782241441.480746:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140062976:12345-0@lo:400:kworker.0 Request processed in 36us (2198us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241441.480747:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1868815140062336:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1782241441.480752:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1782241441.480791:0:18555:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000100:00100000:0.0:1782241441.480797:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782241441.480802:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140062592:12345-0@lo:400:kworker.0 00000020:00000080:3.0:1782241441.480819:0:18555:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e1ab4c 00002000:00100000:3.0:1782241441.480833:0:18555:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff890d46710000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1782241441.480838:0:18555:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1782241441.480840:0:18555:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1782241441.480840:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140062592:12345-0@lo:400:kworker.0 Request processed in 38us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241441.480846:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782241441.480880:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241441.480885:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1868815140062464:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1782241441.480901:0:18556:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:0.0:1782241441.480915:0:18556:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9959f2fb1e1ab53 00002000:00100000:0.0:1782241441.480921:0:18556:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff890e7c197800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1782241441.480924:0:18555:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:0.0:1782241441.480924:0:18556:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1782241441.480926:0:18556:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:3.0:1782241441.480945:0:18555:0:(import.c:65:import_set_state_nolock()) ffff890d46712000 : changing import state from RECOVER to FULL 00002000:00080000:0.0:1782241441.481065:0:18556:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782241441.481079:0:18556:0:(import.c:65:import_set_state_nolock()) ffff890e7c191000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782241441.481109:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1868815140062464:12345-0@lo:8:kworker.0 Request processed in 222us (2457us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241441.481115:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241441.481128:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782241441.481132:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1868815140062848:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1782241441.481145:0:18556:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:0.0:1782241441.481161:0:18556:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc9959f2fb1e1ab5a 00002000:00100000:0.0:1782241441.481167:0:18556:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff890e7c194000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1782241441.481170:0:18556:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1782241441.481171:0:18556:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782241441.481192:0:18556:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1782241441.481204:0:18556:0:(import.c:65:import_set_state_nolock()) ffff890e7c193800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782241441.481230:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3636:x1868815140062848:12345-0@lo:8:kworker.0 Request processed in 97us (2545us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241441.481241:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1782241441.481312:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48200000 x1868815140062976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241441.481324:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48200000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140062976:0@lo:400:kworker.0 00000100:00100000:0.0:1782241441.481336:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782241441.481342:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140063104:0@lo:400:kworker.0 00000100:00100000:0.0:1782241441.481366:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241441.481375:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1868815140062336:12345-0@lo:8:kworker.0 Request processed in 626us (2759us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241441.481382:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1782241441.481394:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48203b80 x1868815140062720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782241457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782241441.481403:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241441.481403:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140062720:0@lo:400:kworker.0 00010000:00080000:0.0:1782241441.481413:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48201880 x1868815140062592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241441.481421:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140062592:0@lo:400:kworker.0 00000100:00100000:0.0:1782241441.481437:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140063104 00000100:00100000:0.0:1782241441.481441:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140063104 00000100:00080000:3.0:1782241441.481460:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241441.481469:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782241441.481474:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140063104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241441.481508:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140063104:12345-0@lo:400:kworker.0 Request processed in 33us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241441.481514:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1782241441.481539:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48202300 x1868815140063104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241441.481548:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140063104:0@lo:400:kworker.0 00000100:00100000:0.0:1782241441.481572:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48200700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140063232:0@lo:400:kworker.0 00000100:00100000:0.0:1782241441.481594:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241441.481603:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140063488:0@lo:400:kworker.0 00000100:00100000:0.0:1782241441.481609:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241441.481613:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815140063360:0@lo:400:kworker.0 00000100:00100000:0.0:1782241441.481631:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241441.481641:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140063232 00000100:00100000:1.0:1782241441.481644:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140063232 00000100:00100000:0.0:1782241441.481651:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241441.481666:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140063360 00000100:00100000:0.0:1782241441.481668:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140063488 00000100:00100000:1.0:1782241441.481669:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140063360 00000100:00100000:0.0:1782241441.481671:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140063488 00000100:00100000:1.0:1782241441.481683:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782241441.481689:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140063232:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782241441.481729:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782241441.481732:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782241441.481910:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140063232:12345-0@lo:400:kworker.0 Request processed in 221us (315us total) trans 0 rc 0/0 00010000:00080000:3.0:1782241441.481940:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48200700 x1868815140063232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241441.481949:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48200700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140063232:0@lo:400:kworker.0 00000100:00100000:0.0:1782241441.481949:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782241441.481957:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815140063360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241441.481987:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1868815140063360:12345-0@lo:400:kworker.0 Request processed in 32us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241441.481993:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782241441.482006:0:17049:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1782241441.482013:0:17049:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1782241441.482101:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1782241441.482109:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782241441.482114:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815140063488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241441.482145:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815140063488:12345-0@lo:400:kworker.0 Request processed in 30us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241441.482152:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1782241441.482176:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48202d80 x1868815140063488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1782241441.482178:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48201f80 x1868815140063360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241441.482185:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140063488:0@lo:400:kworker.0 00000100:00100000:3.0:1782241441.482186:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1868815140063360:0@lo:400:kworker.0 00010000:00080000:2.0:1782241441.482307:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48202a00 x1868815140062848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782241466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782241441.482319:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1782241441.482326:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782241441.482331:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1782241441.482334:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890d469bc000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782241441.482347:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782241441.482352:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1868815140062848:0@lo:8:kworker.0 00000004:00080000:3.0:1782241441.482384:0:17790:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:2.0:1782241441.482386:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48201180 x1868815140062336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782241466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241441.482397:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782241441.482402:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1782241441.482408:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782241441.482411:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1782241441.482421:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e77aae000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782241441.482434:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782241441.482437:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140062336:0@lo:8:kworker.0 00010000:00080000:2.0:1782241441.482451:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48200e00 x1868815140062464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782241466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1782241441.482457:0:17790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 504740699696ns, next at 0ns, rc = 0 00000100:00100000:2.0:1782241441.482458:0:3636:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782241441.482462:0:3636:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00080000:00080000:3.0:1782241441.482463:0:17790:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:2.0:1782241441.482466:0:3636:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782241441.482469:0:3636:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1782241441.482471:0:3636:0:(import.c:65:import_set_state_nolock()) ffff890e67fa6000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782241441.482481:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782241441.482485:0:3636:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48200e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1868815140062464:0@lo:8:kworker.0 00000100:00100000:1.0:1782241441.482641:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1782241441.483973:0:17073:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782241441.484053:0:17073:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 504742295555ns, next at 0ns, rc = 0 00080000:00080000:0.0:1782241441.484068:0:17073:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1782241441.488344:0:17072:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1782241441.488461:0:17072:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47831880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17072:1868815140064000:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1782241441.488538:0:17072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241441.488569:0:17072:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42b1c180 going to sleep for 11 seconds 00000100:00100000:2.0:1782241441.488589:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782241441.488602:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140063616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782241441.488628:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1782241441.488641:0:17791:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000004:00080000:1.0:1782241441.488662:0:17074:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1782241441.488663:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140064000 00000100:00100000:3.0:1782241441.488666:0:17791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17791:1868815140064128:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1782241441.488670:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140064000 00000100:00100000:3.0:1782241441.488701:0:17791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241441.488725:0:17791:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d474ad6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241441.488743:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140064128 00000004:00080000:3.0:1782241441.488746:0:17071:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1782241441.488748:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140064128 00000100:00100000:2.0:1782241441.488792:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782241441.488800:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17072:x1868815140064000:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1782241441.489081:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140063872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241441.489118:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241441.489137:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782241441.489143:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140063744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241441.489164:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1782241441.489330:0:17071:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 504747572606ns, next at 0ns, rc = 0 00080000:00080000:3.0:1782241441.489338:0:17071:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:3.0:1782241441.489357:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782241441.489361:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241441.489374:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782241441.489382:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17791:x1868815140064128:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1782241441.490114:0:17074:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17074:1868815140064256:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1782241441.490159:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241441.490173:0:17074:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d477cb540 going to sleep for 11 seconds 00000100:00100000:1.0:1782241441.490195:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140063616 00000100:00100000:1.0:1782241441.490201:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140063616 00000100:00100000:1.0:1782241441.490228:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140063872 00000100:00100000:1.0:1782241441.490231:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140063872 00000100:00100000:1.0:1782241441.490245:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140063744 00000100:00100000:1.0:1782241441.490248:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140063744 00000100:00100000:1.0:1782241441.490278:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782241441.490285:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1868815140063616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782241441.490417:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1782241441.490468:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1868815140063616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241441.490486:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782241441.490504:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782241441.490511:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1868815140063872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782241441.490528:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1782241441.490563:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1868815140063872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241441.490569:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782241441.490581:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782241441.490589:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1868815140063744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782241441.490611:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1782241441.490639:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1868815140063744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241441.490653:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1782241441.490705:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47833b80 x1868815140063616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241441.490725:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140063616:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1782241441.490775:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48203100 x1868815140063744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241441.490787:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140063744:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1782241441.490801:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47b4fb80 x1868815140063872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782241457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241441.490812:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140063872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241441.491516:0:18554:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1782241441.491527:0:18554:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00080000:3.0:1782241441.492629:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1782241441.493919:0:17027:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1782241441.494792:0:19173:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1782241441.494799:0:19173:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1782241441.494980:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17791:x1868815140064128:12345-0@lo:7:osp-pre-1-1.0 Request processed in 5592us (6271us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241441.494993:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782241441.495197:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140064256 00000100:00100000:3.0:1782241441.495206:0:19173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140064256 00000100:00100000:3.0:1782241441.495240:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782241441.495248:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17074:x1868815140064256:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1782241441.496152:0:17027:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:0.0:1782241441.497363:0:17791:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47b4d180 x1868815140064128/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782241457 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241441.497399:0:17791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17791:1868815140064128:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1782241441.497415:0:17791:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1782241441.497463:0:17791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48038a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17791:1868815140064384:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1782241441.497531:0:17791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241441.497560:0:17791:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4286b780 going to sleep for 11 seconds 00000100:00100000:2.0:1782241441.497983:0:18554:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1782241441.497994:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140064384 00000100:00100000:2.0:1782241441.497999:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140064384 00000100:00100000:1.0:1782241441.498134:0:19502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782241441.498146:0:19502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17791:x1868815140064384:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1782241441.498174:0:19502:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1782241441.498224:0:19502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17791:x1868815140064384:12345-0@lo:5:osp-pre-1-1.0 Request processed in 81us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241441.498232:0:19502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1782241441.498929:0:17791:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48038a80 x1868815140064384/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782241457 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241441.498943:0:17791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48038a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17791:1868815140064384:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1782241441.498957:0:17791:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1782241441.498996:0:17791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47832d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17791:1868815140064512:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1782241441.499030:0:17791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241441.499061:0:17791:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42b1c840 going to sleep for 11 seconds 00000100:00100000:1.0:1782241441.499145:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140064512 00000100:00100000:1.0:1782241441.499150:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140064512 00000100:00100000:1.0:1782241441.499188:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782241441.499195:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17791:x1868815140064512:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1782241441.499226:0:18554:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:2.0:1782241441.501797:0:18556:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1782241441.501810:0:18556:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1782241441.501817:0:18556:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00080000:3.0:1782241441.509986:0:19173:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1782241441.510000:0:19173:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1782241441.510006:0:19173:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000004:00080000:2.0:1782241441.517626:0:17780:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:0.0:1782241441.520616:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.520633:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1ab61 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.520650:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.520655:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.520661:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1ab61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.520679:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1ab61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.520690:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1ab61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.520787:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1ab61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.520822:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782241441.521948:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241441.521957:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1ab61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782241441.521961:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.521972:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c8a270/0xc9959f2fb1e1ab68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.521974:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241441.521981:0:18201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1ab61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.521987:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.521992:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.521997:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c8a270/0xc9959f2fb1e1ab68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.522021:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c8a270/0xc9959f2fb1e1ab68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.522022:0:18201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1ab61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.522043:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c8a270/0xc9959f2fb1e1ab68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.522052:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c8a270/0xc9959f2fb1e1ab68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.522055:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1ab61 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.522069:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000348c0954/0xc9959f2fb1e1ab61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.522072:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241441.522803:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241441.522818:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c8a270/0xc9959f2fb1e1ab68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.522827:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241441.522830:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c8a270/0xc9959f2fb1e1ab68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.522839:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c8a270/0xc9959f2fb1e1ab68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.522853:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c8a270/0xc9959f2fb1e1ab68 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.522860:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c8a270/0xc9959f2fb1e1ab68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.522892:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241441.522894:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241441.522896:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.522960:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.522962:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.522964:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241441.523555:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.523563:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bce3e1f/0xc9959f2fb1e1ab6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.523575:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.523585:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.523592:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bce3e1f/0xc9959f2fb1e1ab6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.523603:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bce3e1f/0xc9959f2fb1e1ab6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.523612:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bce3e1f/0xc9959f2fb1e1ab6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.523619:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bce3e1f/0xc9959f2fb1e1ab6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.523645:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241441.523901:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241441.523908:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bce3e1f/0xc9959f2fb1e1ab6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.523916:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241441.523920:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bce3e1f/0xc9959f2fb1e1ab6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.523941:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bce3e1f/0xc9959f2fb1e1ab6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.523955:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bce3e1f/0xc9959f2fb1e1ab6f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.523963:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bce3e1f/0xc9959f2fb1e1ab6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.523981:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241441.523982:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241441.523984:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241441.525475:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.525489:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9c898a/0xc9959f2fb1e1ab76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.525509:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.525515:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.525522:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9c898a/0xc9959f2fb1e1ab76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.525539:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd9c898a/0xc9959f2fb1e1ab76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.525550:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd9c898a/0xc9959f2fb1e1ab76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.525575:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd9c898a/0xc9959f2fb1e1ab76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.525604:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241441.525640:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241441.525648:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd9c898a/0xc9959f2fb1e1ab76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.525667:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241441.525671:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9c898a/0xc9959f2fb1e1ab76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.525682:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd9c898a/0xc9959f2fb1e1ab76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.525794:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd9c898a/0xc9959f2fb1e1ab76 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.525816:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd9c898a/0xc9959f2fb1e1ab76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.525835:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241441.525837:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241441.525839:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241441.532472:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.532487:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f974f0/0xc9959f2fb1e1ab7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.532505:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.532510:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.532516:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f974f0/0xc9959f2fb1e1ab7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.532530:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f974f0/0xc9959f2fb1e1ab7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.532540:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f974f0/0xc9959f2fb1e1ab7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.532548:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069f974f0/0xc9959f2fb1e1ab7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.532567:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782241441.532961:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.532967:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b50e9e4/0xc9959f2fb1e1ab84 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.532981:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.532984:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.532988:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b50e9e4/0xc9959f2fb1e1ab84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.532996:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b50e9e4/0xc9959f2fb1e1ab84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.533004:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b50e9e4/0xc9959f2fb1e1ab84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.533011:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b50e9e4/0xc9959f2fb1e1ab84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.533025:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782241441.533472:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782241441.533622:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069f974f0/0xc9959f2fb1e1ab7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.533633:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241441.533638:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f974f0/0xc9959f2fb1e1ab7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.533649:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f974f0/0xc9959f2fb1e1ab7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.533667:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069f974f0/0xc9959f2fb1e1ab7d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.533675:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f974f0/0xc9959f2fb1e1ab7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.533782:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241441.533788:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b50e9e4/0xc9959f2fb1e1ab84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.533802:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f0e00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241441.533806:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b50e9e4/0xc9959f2fb1e1ab84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.533815:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b50e9e4/0xc9959f2fb1e1ab84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782241441.533818:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.533829:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037910b99/0xc9959f2fb1e1ab8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.533834:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b50e9e4/0xc9959f2fb1e1ab84 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.533843:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b50e9e4/0xc9959f2fb1e1ab84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.533856:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241441.533857:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241441.533859:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.534457:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241441.534532:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.534536:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.534542:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037910b99/0xc9959f2fb1e1ab8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.534554:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037910b99/0xc9959f2fb1e1ab8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.534577:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037910b99/0xc9959f2fb1e1ab8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.534584:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037910b99/0xc9959f2fb1e1ab8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.534608:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782241441.535168:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241441.535185:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037910b99/0xc9959f2fb1e1ab8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.535194:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e778f1000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241441.535198:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037910b99/0xc9959f2fb1e1ab8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.535207:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037910b99/0xc9959f2fb1e1ab8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.535221:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037910b99/0xc9959f2fb1e1ab8b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.535236:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037910b99/0xc9959f2fb1e1ab8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.535255:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.535257:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.535258:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241441.535448:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.535455:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d5ccd6/0xc9959f2fb1e1ab92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.535464:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.535468:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.535473:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d5ccd6/0xc9959f2fb1e1ab92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.535484:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d5ccd6/0xc9959f2fb1e1ab92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.535494:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d5ccd6/0xc9959f2fb1e1ab92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.535502:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d5ccd6/0xc9959f2fb1e1ab92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.535568:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782241441.535917:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.535923:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1ab99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.535931:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.535935:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.535940:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1ab99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.535951:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1ab99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.535959:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1ab99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.535967:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1ab99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.541025:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782241441.541036:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d5ccd6/0xc9959f2fb1e1ab92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.541050:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499a200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241441.541056:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d5ccd6/0xc9959f2fb1e1ab92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.541067:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d5ccd6/0xc9959f2fb1e1ab92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.541087:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d5ccd6/0xc9959f2fb1e1ab92 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.541094:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d5ccd6/0xc9959f2fb1e1ab92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.541114:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241441.541117:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1ab99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.541130:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499aa00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241441.541133:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1ab99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.541140:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1ab99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.541149:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1ab99 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.541155:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.541157:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.541158:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241441.541391:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241441.541400:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e62a7885/0xc9959f2fb1e1aba0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.541412:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1782241441.541415:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241441.541421:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e62a7885/0xc9959f2fb1e1aba0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.541441:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e62a7885/0xc9959f2fb1e1aba0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.541451:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e62a7885/0xc9959f2fb1e1aba0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.541458:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e62a7885/0xc9959f2fb1e1aba0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.541484:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782241441.542099:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.542122:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241441.542132:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e62a7885/0xc9959f2fb1e1aba0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.542139:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164cc00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241441.542142:0:18201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e62a7885/0xc9959f2fb1e1aba0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.542150:0:18201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e62a7885/0xc9959f2fb1e1aba0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.542165:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e62a7885/0xc9959f2fb1e1aba0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.542177:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e62a7885/0xc9959f2fb1e1aba0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.542192:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.542194:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.542195:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.542220:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088a2988a/0xc9959f2fb1e1aba7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.542229:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1782241441.542232:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241441.542237:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088a2988a/0xc9959f2fb1e1aba7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.542247:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088a2988a/0xc9959f2fb1e1aba7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.542254:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088a2988a/0xc9959f2fb1e1aba7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.542261:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088a2988a/0xc9959f2fb1e1aba7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.542278:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241441.542784:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241441.542791:0:18556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1ab99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.543027:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241441.543032:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088a2988a/0xc9959f2fb1e1aba7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.543040:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164c000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241441.543044:0:18201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088a2988a/0xc9959f2fb1e1aba7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.543053:0:18201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088a2988a/0xc9959f2fb1e1aba7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.543066:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088a2988a/0xc9959f2fb1e1aba7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.543073:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088a2988a/0xc9959f2fb1e1aba7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.543086:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.543087:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.543089:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.543100:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.543105:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241441.543557:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.543564:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1abae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.543580:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.543584:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.543589:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1abae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.543599:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1abae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.543608:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1abae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.543617:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1abae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.543639:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782241441.543962:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241441.543969:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1abb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.543977:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1782241441.543986:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241441.543990:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1abb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.544001:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1abb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.544009:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1abb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.544016:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1abb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.544031:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782241441.544432:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782241441.544440:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1abae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.544450:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499b200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241441.544453:0:18201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1abae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.544461:0:18201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1abae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.544476:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1abae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.544483:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cca4a612/0xc9959f2fb1e1abae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.544501:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241441.544505:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1abb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.544511:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241441.544514:0:18201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1abb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.544533:0:18201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1abb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.544545:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1abb5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.544551:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1abb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.544564:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.544566:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.544568:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.544574:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241441.544664:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241441.544670:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1abbc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.544679:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1782241441.544681:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241441.544685:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1abbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.544694:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1abbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.544701:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1abbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.544714:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1abbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.544734:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782241441.545251:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.545258:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1abc3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.545267:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.545271:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.545275:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1abc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.545285:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1abc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.545307:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1abc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.545314:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1abc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.545422:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241441.545428:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1abbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.545436:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241441.545440:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1abbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.545447:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1abbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.545458:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1abbc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.545472:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1abbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.545487:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.545489:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.545490:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241441.545988:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241441.545995:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1abca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.546003:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1782241441.546006:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241441.546010:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1abca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.546020:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1abca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.546029:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1abca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.546036:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1abca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.546054:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241441.546282:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782241441.546310:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782241441.546318:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1abca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.546399:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241441.546404:0:18201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1abca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.546412:0:18201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1abca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.546426:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1abca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.546432:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1abca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.546448:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241441.546451:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1abc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.546464:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499be00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241441.546467:0:18201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1abc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.546475:0:18201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1abc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.546487:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1abc3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.546494:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1abc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.546508:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.546510:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.546511:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241441.546949:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241441.546957:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007231f4a7/0xc9959f2fb1e1abd1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.546968:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1782241441.546972:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241441.546976:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007231f4a7/0xc9959f2fb1e1abd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.547000:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007231f4a7/0xc9959f2fb1e1abd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.547008:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007231f4a7/0xc9959f2fb1e1abd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.547016:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007231f4a7/0xc9959f2fb1e1abd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.547029:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241441.547083:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.547089:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007231f4a7/0xc9959f2fb1e1abd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.547105:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499a600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.547109:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007231f4a7/0xc9959f2fb1e1abd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.547118:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007231f4a7/0xc9959f2fb1e1abd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.547134:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007231f4a7/0xc9959f2fb1e1abd1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.547141:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007231f4a7/0xc9959f2fb1e1abd1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.547157:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.547159:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.547161:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.547210:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241441.547468:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241441.547474:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1abd8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.547483:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1782241441.547486:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241441.547490:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1abd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.547499:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1abd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.547507:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1abd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.547526:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1abd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.547549:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782241441.547861:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241441.547878:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000145b77a9/0xc9959f2fb1e1abdf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.547887:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1782241441.547889:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241441.547893:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000145b77a9/0xc9959f2fb1e1abdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.547901:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000145b77a9/0xc9959f2fb1e1abdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.547910:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000145b77a9/0xc9959f2fb1e1abdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.547917:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000145b77a9/0xc9959f2fb1e1abdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.547929:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1782241441.548066:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.548072:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1abe6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.548082:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.548084:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.548088:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1abe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.548098:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1abe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.548106:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1abe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.548113:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1abe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.548129:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1782241441.548171:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782241441.548178:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1abd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.548449:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241441.548454:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000145b77a9/0xc9959f2fb1e1abdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.548462:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.548466:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000145b77a9/0xc9959f2fb1e1abdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.548474:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000145b77a9/0xc9959f2fb1e1abdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.548495:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000145b77a9/0xc9959f2fb1e1abdf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.548502:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000145b77a9/0xc9959f2fb1e1abdf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.548516:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.548519:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1abe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.548531:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499bc00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241441.548532:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ebe00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.548535:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1abe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.548538:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1abd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.548557:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1abe6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.548558:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1abd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.548581:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1abe6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.548587:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1abd8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.548593:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b92db38/0xc9959f2fb1e1abe6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.548600:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbb96d27/0xc9959f2fb1e1abd8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.548615:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.548619:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241441.548622:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241441.548625:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.548628:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241441.548629:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.548636:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241441.548671:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241441.548678:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1abed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.548686:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1782241441.548688:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241441.548692:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1abed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.548703:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1abed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.548719:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1abed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.548726:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1abed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.548745:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782241441.549334:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241441.549341:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1abf4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549352:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1782241441.549355:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241441.549360:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1abf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549370:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1abf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549378:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1abf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549386:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1abf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549412:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782241441.549420:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782241441.549424:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1abed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549432:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241441.549435:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1abed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549443:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1abed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549457:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1abed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549464:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1cefa68/0xc9959f2fb1e1abed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549479:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241441.549483:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1abf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782241441.549487:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241441.549492:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c2000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241441.549497:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1abfb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549498:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1abf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.549520:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.549527:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.549536:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1abfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549539:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1abf4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.549553:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1abfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549558:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1abf4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.549566:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1abfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549569:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1abf4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.549582:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1abfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549592:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241441.549595:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241441.549597:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782241441.549599:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1abfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549607:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499aa00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241441.549611:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1abfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549621:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1abfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549634:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1abfb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549642:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba28b41d/0xc9959f2fb1e1abfb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.549663:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241441.549665:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241441.549667:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.549943:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.549949:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241441.549989:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241441.549995:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724a6da4/0xc9959f2fb1e1ac02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.550005:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1782241441.550009:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241441.550013:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000724a6da4/0xc9959f2fb1e1ac02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.550023:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000724a6da4/0xc9959f2fb1e1ac02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.550031:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724a6da4/0xc9959f2fb1e1ac02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.550039:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000724a6da4/0xc9959f2fb1e1ac02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.550158:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782241441.550454:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241441.550459:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bafcfca/0xc9959f2fb1e1ac09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.550476:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1782241441.550479:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241441.550483:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bafcfca/0xc9959f2fb1e1ac09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.550492:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bafcfca/0xc9959f2fb1e1ac09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.550500:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bafcfca/0xc9959f2fb1e1ac09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.550507:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bafcfca/0xc9959f2fb1e1ac09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.550632:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241441.550639:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000724a6da4/0xc9959f2fb1e1ac02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.550647:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c3200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.550650:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000724a6da4/0xc9959f2fb1e1ac02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.550659:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000724a6da4/0xc9959f2fb1e1ac02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.550671:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000724a6da4/0xc9959f2fb1e1ac02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.550679:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000724a6da4/0xc9959f2fb1e1ac02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.550697:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.550702:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bafcfca/0xc9959f2fb1e1ac09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.550708:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c3800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.550712:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bafcfca/0xc9959f2fb1e1ac09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.550732:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bafcfca/0xc9959f2fb1e1ac09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.550744:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bafcfca/0xc9959f2fb1e1ac09 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.550753:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.550877:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.550881:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241441.551060:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.551067:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.551076:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.551079:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.551084:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.551104:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.551111:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.551117:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.551377:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782241441.551383:0:18556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bafcfca/0xc9959f2fb1e1ac09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.552187:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.552195:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.552204:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499ba00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.552208:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.552217:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.552233:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac10 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.552242:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.552243:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.552245:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241441.553751:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782241441.553777:0:19173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.553963:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241441.555735:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.555745:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1ac17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.555799:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.555804:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.555811:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1ac17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.555825:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1ac17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.555858:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1ac17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.555876:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1ac17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.555899:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782241441.556465:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241441.556472:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f63605/0xc9959f2fb1e1ac1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.556483:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1782241441.556487:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241441.556492:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032f63605/0xc9959f2fb1e1ac1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.556514:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032f63605/0xc9959f2fb1e1ac1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.556523:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f63605/0xc9959f2fb1e1ac1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.556530:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032f63605/0xc9959f2fb1e1ac1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.556545:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782241441.556630:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782241441.556638:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1ac17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.556646:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499b400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241441.556650:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1ac17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.556665:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241441.556671:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1ac17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.556673:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032f63605/0xc9959f2fb1e1ac1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.556692:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c2200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.556696:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f63605/0xc9959f2fb1e1ac1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.556700:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1ac17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.556707:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f63605/0xc9959f2fb1e1ac1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.556711:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4d698b2/0xc9959f2fb1e1ac17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.556725:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032f63605/0xc9959f2fb1e1ac1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.556733:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.556734:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032f63605/0xc9959f2fb1e1ac1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.556736:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.556740:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.556779:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.556782:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.556783:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782241441.560196:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782241441.560215:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1ac25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.561904:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1782241441.561912:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241441.561924:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1ac25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.561946:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1ac25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.561960:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1ac25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.561992:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1ac25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241441.562026:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241441.562112:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241441.562127:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1ac25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.562141:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e821c2000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241441.562147:0:18201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1ac25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.562157:0:18201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1ac25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.562179:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1ac25 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.562188:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001343e1eb/0xc9959f2fb1e1ac25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.562215:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241441.562229:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241441.562231:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241441.564489:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.564503:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.564520:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.564523:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.564529:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.564541:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.564550:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.564557:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.564571:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782241441.564918:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241441.564932:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.564945:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499ba00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241441.564951:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.564962:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.564984:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.565010:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaa51602/0xc9959f2fb1e1ac2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.565031:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.565033:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.565036:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241441.565534:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.565543:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1ac33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.565555:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.565558:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.565563:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1ac33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782241441.565578:0:19368:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1782241441.565585:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1ac33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.565596:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1ac33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.565603:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1ac33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1782241441.565608:0:19368:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1782241441.565618:0:19368:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1782241441.565624:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241441.565941:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.565951:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1ac33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.565963:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499ac00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.565967:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1ac33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.565988:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1ac33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.566004:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1ac33 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.566012:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cb1cd62/0xc9959f2fb1e1ac33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.566028:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.566030:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.566032:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241441.566120:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241441.566127:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1ac3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.566138:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1782241441.566143:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241441.566148:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1ac3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.566160:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1ac3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.566169:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1ac3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.566183:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1ac3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.566205:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241441.566216:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.566221:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1ac3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.566228:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.566231:0:18201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1ac3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241441.566880:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17791:x1868815140064512:12345-0@lo:5:osp-pre-1-1.0 Request processed in 67671us (67834us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1782241441.566893:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782241441.566972:0:17791:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1782241441.566989:0:17791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47832d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17791:1868815140064512:0@lo:5:osp-pre-1-1.0 00010000:00010000:3.0:1782241441.567013:0:18201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1ac3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782241441.567026:0:17791:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00010000:00010000:3.0:1782241441.567033:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1ac3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.567042:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000493a6544/0xc9959f2fb1e1ac3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241441.567085:0:17791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17791:1868815140064640:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1782241441.567122:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.567125:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.567128:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241441.567159:0:17791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241441.567201:0:17791:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d540 going to sleep for 11 seconds 00002000:00010000:0.0:1782241441.567283:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.567290:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fefb257/0xc9959f2fb1e1ac41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.567304:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.567308:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.567313:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fefb257/0xc9959f2fb1e1ac41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.567351:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fefb257/0xc9959f2fb1e1ac41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.567361:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fefb257/0xc9959f2fb1e1ac41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.567367:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fefb257/0xc9959f2fb1e1ac41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.567381:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782241441.567740:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.567746:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000791fde89/0xc9959f2fb1e1ac48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.567779:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.567784:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.567789:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000791fde89/0xc9959f2fb1e1ac48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.567798:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000791fde89/0xc9959f2fb1e1ac48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.567805:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000791fde89/0xc9959f2fb1e1ac48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.567824:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000791fde89/0xc9959f2fb1e1ac48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.567926:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782241441.567935:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241441.567956:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fefb257/0xc9959f2fb1e1ac41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.567967:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499a400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.567974:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fefb257/0xc9959f2fb1e1ac41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.567985:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fefb257/0xc9959f2fb1e1ac41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.568003:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fefb257/0xc9959f2fb1e1ac41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.568012:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fefb257/0xc9959f2fb1e1ac41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.568033:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.568037:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000791fde89/0xc9959f2fb1e1ac48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.568043:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499a800 already unused, calling callback (ffffffffc0cc6ce0) 00000100:00100000:2.0:1782241441.568127:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140064640 00000100:00100000:2.0:1782241441.568137:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140064640 00000100:00100000:2.0:1782241441.568205:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782241441.568216:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17791:x1868815140064640:12345-0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1782241441.568586:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000791fde89/0xc9959f2fb1e1ac48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.568596:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000791fde89/0xc9959f2fb1e1ac48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.568626:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000791fde89/0xc9959f2fb1e1ac48 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.568634:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000791fde89/0xc9959f2fb1e1ac48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241441.568644:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17791:x1868815140064640:12345-0@lo:900:osp-pre-1-1.0 Request processed in 430us (1486us total) trans 0 rc 0/0 00010000:00010000:3.0:1782241441.568652:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241441.568653:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1782241441.568654:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.568656:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782241441.569037:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782241441.569044:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087aded48/0xc9959f2fb1e1ac4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.569059:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.569062:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241441.569066:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087aded48/0xc9959f2fb1e1ac4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.569075:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087aded48/0xc9959f2fb1e1ac4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.569081:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087aded48/0xc9959f2fb1e1ac4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.569087:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087aded48/0xc9959f2fb1e1ac4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.569101:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241441.569124:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.569131:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087aded48/0xc9959f2fb1e1ac4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.569140:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499ae00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.569144:0:18201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087aded48/0xc9959f2fb1e1ac4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.569152:0:18201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087aded48/0xc9959f2fb1e1ac4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.569163:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087aded48/0xc9959f2fb1e1ac4f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.569170:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087aded48/0xc9959f2fb1e1ac4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.569195:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.569197:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.569199:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1782241441.569509:0:17791:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4803b100 x1868815140064640/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782241457 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241441.569526:0:17791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17791:1868815140064640:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1782241441.569569:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241441.569880:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241441.569887:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1ac56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.569898:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1782241441.569902:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241441.569907:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1ac56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.569918:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1ac56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.569926:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1ac56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.569933:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1ac56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.569955:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241441.570150:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241441.570156:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1ac56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.570172:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241441.570175:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1ac56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.570183:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1ac56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782241441.570185:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.570191:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4c8ef29/0xc9959f2fb1e1ac5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.570200:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1ac56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.570206:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1782241441.570208:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006071cf3e/0xc9959f2fb1e1ac56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.570209:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.570214:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c8ef29/0xc9959f2fb1e1ac5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.570224:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4c8ef29/0xc9959f2fb1e1ac5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.570232:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4c8ef29/0xc9959f2fb1e1ac5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.570239:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c8ef29/0xc9959f2fb1e1ac5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.570255:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241441.570303:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241441.570306:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4c8ef29/0xc9959f2fb1e1ac5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.570313:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241441.570317:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c8ef29/0xc9959f2fb1e1ac5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.570324:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c8ef29/0xc9959f2fb1e1ac5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.570336:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4c8ef29/0xc9959f2fb1e1ac5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.570349:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4c8ef29/0xc9959f2fb1e1ac5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.570366:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241441.570367:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241441.570369:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.570418:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782241441.570643:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782241441.570649:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1ac64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.570667:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1782241441.570671:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241441.570675:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1ac64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.570685:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1ac64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.570694:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1ac64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.570702:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1ac64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782241441.570797:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.570803:0:18556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1ac6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.570811:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.570814:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.570818:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1ac6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.570827:0:18556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1ac6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.570847:0:18556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1ac6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.570855:0:18556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1ac6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.570944:0:18556:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782241441.570952:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1782241441.570985:0:18556:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00010000:00010000:0.0:1782241441.571081:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782241441.571088:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1ac64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.571096:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241441.571100:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1ac64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.571109:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1ac64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.571127:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1ac64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.571135:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062623338/0xc9959f2fb1e1ac64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.571149:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241441.571152:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1ac6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.571165:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241441.571168:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1ac6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241441.571170:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17072:x1868815140064000:12345-0@lo:5:osp-pre-0-0.0 Request processed in 82367us (82630us total) trans 0 rc 0/0 00010000:00010000:0.0:1782241441.571177:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1ac6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241441.571182:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1782241441.571187:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1ac6b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.571207:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006210680a/0xc9959f2fb1e1ac6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.571457:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241441.571459:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241441.571461:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241441.571467:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241441.571513:0:17072:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47831880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17072:1868815140064000:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1782241441.571533:0:17072:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1782241441.571603:0:17072:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17072:1868815140064768:0@lo:5:osp-pre-0-0.0 00002000:00010000:2.0:1782241441.571641:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.571648:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1ac72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241441.571653:0:17072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782241441.571659:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.571662:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.571667:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1ac72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.571683:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1ac72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.571692:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1ac72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.571712:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1ac72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.571827:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782241441.571835:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241441.571839:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1ac72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241441.571841:0:17072:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d540 going to sleep for 11 seconds 00010000:00010000:2.0:1782241441.571847:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860800 already unused, calling callback (ffffffffc0cc6ce0) 00000100:00100000:0.0:1782241441.571886:0:19502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140064768 00000100:00100000:0.0:1782241441.571895:0:19502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140064768 00000100:00100000:0.0:1782241441.571976:0:19502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782241441.571986:0:19502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17072:x1868815140064768:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1782241441.572035:0:19502:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:2.0:1782241441.572055:0:18201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1ac72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.572065:0:18201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1ac72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.572080:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1ac72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.572088:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000933adb91/0xc9959f2fb1e1ac72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.572104:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.572105:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.572107:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782241441.572576:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.572593:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077971168/0xc9959f2fb1e1ac79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.572605:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.572614:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.572618:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077971168/0xc9959f2fb1e1ac79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.572629:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077971168/0xc9959f2fb1e1ac79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.572640:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077971168/0xc9959f2fb1e1ac79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.572649:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077971168/0xc9959f2fb1e1ac79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.572667:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241441.572677:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.572683:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077971168/0xc9959f2fb1e1ac79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.572703:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b861400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.572706:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077971168/0xc9959f2fb1e1ac79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.572714:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077971168/0xc9959f2fb1e1ac79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.572817:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077971168/0xc9959f2fb1e1ac79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.572825:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077971168/0xc9959f2fb1e1ac79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.572839:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.572841:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.572842:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782241441.573450:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.573458:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b549703/0xc9959f2fb1e1ac80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.573469:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.573474:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.573479:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b549703/0xc9959f2fb1e1ac80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.573490:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b549703/0xc9959f2fb1e1ac80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.573506:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b549703/0xc9959f2fb1e1ac80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.573526:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b549703/0xc9959f2fb1e1ac80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.573552:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241441.573837:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.573845:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b549703/0xc9959f2fb1e1ac80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.573854:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.573857:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b549703/0xc9959f2fb1e1ac80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.573878:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b549703/0xc9959f2fb1e1ac80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.573902:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b549703/0xc9959f2fb1e1ac80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.573909:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b549703/0xc9959f2fb1e1ac80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.573923:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.573925:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.573927:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782241441.574034:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.574039:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6b4942/0xc9959f2fb1e1ac87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.574048:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.574052:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.574056:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6b4942/0xc9959f2fb1e1ac87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.574066:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f6b4942/0xc9959f2fb1e1ac87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.574073:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6b4942/0xc9959f2fb1e1ac87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.574081:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f6b4942/0xc9959f2fb1e1ac87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.574142:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241441.574365:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.574371:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f6b4942/0xc9959f2fb1e1ac87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.574379:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac800 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.574383:0:18201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f6b4942/0xc9959f2fb1e1ac87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.574392:0:18201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f6b4942/0xc9959f2fb1e1ac87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.574405:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f6b4942/0xc9959f2fb1e1ac87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.574413:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f6b4942/0xc9959f2fb1e1ac87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.574441:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.574443:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.574445:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782241441.574538:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.574544:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028a456b9/0xc9959f2fb1e1ac8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.574552:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.574556:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.574560:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028a456b9/0xc9959f2fb1e1ac8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.574570:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028a456b9/0xc9959f2fb1e1ac8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.574578:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028a456b9/0xc9959f2fb1e1ac8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.574585:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028a456b9/0xc9959f2fb1e1ac8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.574607:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782241441.575000:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.575007:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1ac95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575016:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.575029:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.575035:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1ac95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575057:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1ac95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575066:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1ac95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575074:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1ac95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575092:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782241441.575101:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782241441.575106:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028a456b9/0xc9959f2fb1e1ac8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575114:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241441.575118:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028a456b9/0xc9959f2fb1e1ac8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575127:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028a456b9/0xc9959f2fb1e1ac8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575139:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028a456b9/0xc9959f2fb1e1ac8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575159:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028a456b9/0xc9959f2fb1e1ac8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575175:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782241441.575178:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1ac95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575186:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241441.575189:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1ac95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575197:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1ac95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575209:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1ac95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575216:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3782bbd/0xc9959f2fb1e1ac95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575228:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.575230:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.575232:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.575387:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782241441.575594:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.575601:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea530b78/0xc9959f2fb1e1ac9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575616:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.575620:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.575625:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea530b78/0xc9959f2fb1e1ac9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575636:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea530b78/0xc9959f2fb1e1ac9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575644:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea530b78/0xc9959f2fb1e1ac9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575652:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea530b78/0xc9959f2fb1e1ac9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.575721:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782241441.576212:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.576219:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae61d68/0xc9959f2fb1e1aca3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.576229:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.576233:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.576238:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ae61d68/0xc9959f2fb1e1aca3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.576247:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ae61d68/0xc9959f2fb1e1aca3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.576267:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae61d68/0xc9959f2fb1e1aca3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.576275:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ae61d68/0xc9959f2fb1e1aca3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.576318:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241441.576327:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea530b78/0xc9959f2fb1e1ac9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.576345:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43facc00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.576350:0:18201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea530b78/0xc9959f2fb1e1ac9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.576359:0:18201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea530b78/0xc9959f2fb1e1ac9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.576375:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea530b78/0xc9959f2fb1e1ac9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.576382:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea530b78/0xc9959f2fb1e1ac9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.576400:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.576403:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ae61d68/0xc9959f2fb1e1aca3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.576409:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.576419:0:18201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae61d68/0xc9959f2fb1e1aca3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.576427:0:18201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae61d68/0xc9959f2fb1e1aca3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.576436:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ae61d68/0xc9959f2fb1e1aca3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.576443:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.576445:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.576446:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.576530:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782241441.576535:0:19173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ae61d68/0xc9959f2fb1e1aca3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.576879:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782241441.576972:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.576978:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008714ec2/0xc9959f2fb1e1acaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.576988:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.576992:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.576996:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008714ec2/0xc9959f2fb1e1acaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.577006:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008714ec2/0xc9959f2fb1e1acaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.577014:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008714ec2/0xc9959f2fb1e1acaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.577032:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008714ec2/0xc9959f2fb1e1acaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.577137:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782241441.577426:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.577432:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1acb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.577441:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.577445:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.577449:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1acb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.577458:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1acb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.577466:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1acb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.577473:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1acb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.577574:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782241441.577581:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008714ec2/0xc9959f2fb1e1acaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.577590:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.577594:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008714ec2/0xc9959f2fb1e1acaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.577602:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008714ec2/0xc9959f2fb1e1acaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.577614:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008714ec2/0xc9959f2fb1e1acaa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.577618:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008714ec2/0xc9959f2fb1e1acaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.577643:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.577646:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1acb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.577650:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fade00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.577653:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1acb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.577657:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1acb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.577663:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1acb1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.577667:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.577669:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.577671:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241441.577836:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782241441.577841:0:19173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcdc4d10/0xc9959f2fb1e1acb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.577980:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782241441.578127:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.578133:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fd30914/0xc9959f2fb1e1acb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.578142:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.578146:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.578151:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fd30914/0xc9959f2fb1e1acb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.578160:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fd30914/0xc9959f2fb1e1acb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.578168:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fd30914/0xc9959f2fb1e1acb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.578175:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fd30914/0xc9959f2fb1e1acb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.578197:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241441.578500:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.578506:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fd30914/0xc9959f2fb1e1acb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.578677:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fada00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.578682:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fd30914/0xc9959f2fb1e1acb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.578703:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fd30914/0xc9959f2fb1e1acb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.579092:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fd30914/0xc9959f2fb1e1acb8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.579101:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fd30914/0xc9959f2fb1e1acb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.579122:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.579124:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.579126:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782241441.579329:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.579336:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1acbf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.579347:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.579351:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.579364:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1acbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.579376:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1acbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.579385:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1acbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.579394:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1acbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.579416:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241441.579577:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.579584:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1acbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.579594:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad600 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.579598:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1acbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.579608:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1acbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.579620:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1acbf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.579639:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cebbfee/0xc9959f2fb1e1acbf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.579653:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.579655:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.579657:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782241441.579987:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.579994:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002950a58a/0xc9959f2fb1e1acc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.580004:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.580008:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.580012:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002950a58a/0xc9959f2fb1e1acc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.580022:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002950a58a/0xc9959f2fb1e1acc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.580030:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002950a58a/0xc9959f2fb1e1acc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.580052:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002950a58a/0xc9959f2fb1e1acc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.580076:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782241441.580115:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241441.580125:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002950a58a/0xc9959f2fb1e1acc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.580151:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241441.580155:0:18201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002950a58a/0xc9959f2fb1e1acc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.580165:0:18201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002950a58a/0xc9959f2fb1e1acc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.580179:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002950a58a/0xc9959f2fb1e1acc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.580200:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002950a58a/0xc9959f2fb1e1acc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.580220:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241441.580222:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241441.580224:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782241441.580686:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.580706:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000663aba58/0xc9959f2fb1e1accd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.580717:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.580721:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.580726:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000663aba58/0xc9959f2fb1e1accd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.580737:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000663aba58/0xc9959f2fb1e1accd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.580746:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000663aba58/0xc9959f2fb1e1accd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.580782:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000663aba58/0xc9959f2fb1e1accd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.580802:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241441.581057:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.581064:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000663aba58/0xc9959f2fb1e1accd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.581073:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac000 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.581078:0:17035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000663aba58/0xc9959f2fb1e1accd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.581086:0:17035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000663aba58/0xc9959f2fb1e1accd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.581102:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000663aba58/0xc9959f2fb1e1accd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.581109:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000663aba58/0xc9959f2fb1e1accd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.581126:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.581128:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.581129:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782241441.581510:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.581517:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd73c82/0xc9959f2fb1e1acd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.581534:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.581537:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.581543:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dd73c82/0xc9959f2fb1e1acd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.581554:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dd73c82/0xc9959f2fb1e1acd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.581563:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd73c82/0xc9959f2fb1e1acd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.581571:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dd73c82/0xc9959f2fb1e1acd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.581593:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782241441.581782:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782241441.581788:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dd73c82/0xc9959f2fb1e1acd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.581798:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fadc00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:3.0:1782241441.581802:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd73c82/0xc9959f2fb1e1acd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.581810:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd73c82/0xc9959f2fb1e1acd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.581824:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dd73c82/0xc9959f2fb1e1acd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.581833:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dd73c82/0xc9959f2fb1e1acd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241441.581850:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.581852:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782241441.581854:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782241441.582234:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782241441.582240:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d72c83c9/0xc9959f2fb1e1acdb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.582249:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1782241441.582252:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241441.582257:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d72c83c9/0xc9959f2fb1e1acdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.582266:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d72c83c9/0xc9959f2fb1e1acdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.582286:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d72c83c9/0xc9959f2fb1e1acdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.582293:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d72c83c9/0xc9959f2fb1e1acdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241441.582317:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1782241441.582439:0:19173:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00010000:00010000:0.0:1782241441.582606:0:18201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782241441.582614:0:18201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d72c83c9/0xc9959f2fb1e1acdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.582622:0:18201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43face00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:0.0:1782241441.582625:0:18201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d72c83c9/0xc9959f2fb1e1acdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.582633:0:18201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d72c83c9/0xc9959f2fb1e1acdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.582653:0:18201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d72c83c9/0xc9959f2fb1e1acdb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.582660:0:18201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d72c83c9/0xc9959f2fb1e1acdb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241441.582680:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241441.582682:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241441.582685:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241441.582823:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17074:x1868815140064256:12345-0@lo:5:osp-pre-1-0.0 Request processed in 87569us (92656us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241441.582836:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782241441.583211:0:17074:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17074:1868815140064256:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1782241441.583233:0:17074:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1782241441.583355:0:17074:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17074:1868815140064896:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1782241441.583404:0:17074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241441.583438:0:17074:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47befc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241441.583539:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140064896 00000100:00100000:3.0:1782241441.583546:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140064896 00000100:00100000:3.0:1782241441.583600:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782241441.583609:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17074:x1868815140064896:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1782241441.583661:0:18554:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000001:00080000:2.0:1782241441.587013:0:18550:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1782241441.588004:0:18550:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1782241441.588618:0:19502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17072:x1868815140064768:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16625us (16957us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1782241441.588633:0:19502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782241441.588649:0:17072:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1782241441.588662:0:17072:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17072:1868815140064768:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1782241441.588680:0:17072:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:0.0:1782241441.589626:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17074:x1868815140064896:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6012us (6217us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1782241441.589637:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782241441.589861:0:17074:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17074:1868815140064896:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1782241441.589885:0:17074:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:2.0:1782241442.565102:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782241442.949680:0:17800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782241443.588955:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782241444.614304:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782241445.336070:0:19726:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg458-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1782241445.642179:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140065024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782241445.642281:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241445.642366:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140065024 00000100:00100000:1.0:1782241445.642376:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140065024 00000100:00100000:1.0:1782241445.642443:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782241445.642454:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48202680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140065024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782241445.642493:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1782241445.643208:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48202680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140065024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 752us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241445.643218:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782241445.643289:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48203100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140065024:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1782241445.643710:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782241445.648167:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241446.149110:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4803b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140065152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241446.149181:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241446.149255:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782241446.149275:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140065280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241446.149302:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241446.149679:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140065152 00000100:00100000:0.0:1782241446.149688:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140065152 00000100:00100000:0.0:1782241446.149738:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140065280 00000100:00100000:0.0:1782241446.149742:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140065280 00000100:00100000:0.0:1782241446.149796:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782241446.149805:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140065152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241446.149841:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1782241446.149888:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48203100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140065152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241446.149904:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782241446.149923:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782241446.149929:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140065280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241446.149948:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782241446.149982:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140065280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241446.149987:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782241446.150038:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140065280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782241446.150124:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4803b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140065152:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1782241446.410919:0:19778:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782241446.413486:0:19778:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782241446.665433:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241446.665452:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140065408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241446.665521:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241446.665554:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140065920:0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.665578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241446.665596:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140066432:0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.665614:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241446.665636:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815140066944:0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.665659:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241446.665679:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1782241446.665684:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3640:1868815140065792:0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.665706:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241446.665729:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140066304:0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.665748:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241446.665810:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140066816:0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.665832:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241446.665855:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48200e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140065536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782241446.665874:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241446.665886:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140066048:0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.665901:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241446.665911:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140066560:0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.665927:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241446.665938:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140067072:0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.665953:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241446.665974:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782241446.665979:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140065664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782241446.665995:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241446.666003:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48200700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140066176:0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.666018:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241446.666025:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48200000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140066688:0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.666042:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241446.666065:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140065408 00000100:00100000:1.0:1782241446.666072:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140065408 00000100:00100000:1.0:1782241446.666112:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140065536 00000100:00100000:1.0:1782241446.666114:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140065536 00000100:00100000:1.0:1782241446.666124:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140065664 00000100:00100000:1.0:1782241446.666126:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140065664 00000100:00100000:1.0:1782241446.666138:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782241446.666145:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140065408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782241446.666174:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1782241446.666213:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140065408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241446.666220:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782241446.666235:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782241446.666241:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815140065536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782241446.666250:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1782241446.666275:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815140065536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241446.666281:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782241446.666292:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782241446.666298:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140065664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782241446.666315:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1782241446.666341:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140065664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241446.666347:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782241446.666365:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140065920 00000100:00100000:1.0:1782241446.666368:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140065920 00000100:00100000:1.0:1782241446.666389:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140066432 00000100:00100000:1.0:1782241446.666392:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140066432 00000100:00100000:1.0:1782241446.666401:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140066304 00000100:00100000:1.0:1782241446.666403:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140066304 00000100:00100000:1.0:1782241446.666411:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140066048 00000100:00100000:1.0:1782241446.666413:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140066048 00000100:00100000:1.0:1782241446.666423:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782241446.666429:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140065920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241446.666828:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782241446.666837:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140066432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241446.666873:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140066432:12345-0@lo:400:kworker.0 Request processed in 37us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241446.666879:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782241446.666905:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782241446.666911:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140066304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241446.666940:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140066304:12345-0@lo:400:kworker.0 Request processed in 29us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241446.666945:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782241446.666956:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782241446.666961:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815140066048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241446.667005:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815140066048:12345-0@lo:400:kworker.0 Request processed in 43us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241446.667011:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782241446.671840:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140065920:12345-0@lo:400:kworker.0 Request processed in 30us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241446.671856:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782241446.671905:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140066944 00000100:00100000:1.0:1782241446.671913:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140066944 00000100:00100000:1.0:1782241446.671947:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140066816 00000100:00100000:1.0:1782241446.671949:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140066816 00000100:00100000:1.0:1782241446.671959:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140066560 00000100:00100000:1.0:1782241446.671961:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140066560 00000100:00100000:1.0:1782241446.671970:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140067072 00000100:00100000:1.0:1782241446.671973:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140067072 00000100:00100000:1.0:1782241446.671982:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140066176 00000100:00100000:1.0:1782241446.671984:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140066176 00000100:00100000:1.0:1782241446.671992:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140066688 00000100:00100000:1.0:1782241446.671995:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140066688 00000100:00100000:1.0:1782241446.672006:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782241446.672012:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815140066944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.672096:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815140066944:12345-0@lo:400:kworker.0 Request processed in 83us (6435us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241446.672102:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782241446.672112:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782241446.672117:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140066816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.672140:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140066816:12345-0@lo:400:kworker.0 Request processed in 24us (6308us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241446.672145:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782241446.672154:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782241446.672159:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140066560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.672182:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140066560:12345-0@lo:400:kworker.0 Request processed in 23us (6254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241446.672187:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782241446.672195:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782241446.672201:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815140067072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.672223:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815140067072:12345-0@lo:400:kworker.0 Request processed in 23us (6269us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241446.672229:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782241446.672238:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782241446.672243:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140066176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.672268:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140066176:12345-0@lo:400:kworker.0 Request processed in 25us (6250us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241446.672274:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782241446.672283:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782241446.672289:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140066688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.672325:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140066688:12345-0@lo:400:kworker.0 Request processed in 36us (6281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241446.672330:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782241446.672352:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140065792 00000100:00100000:1.0:1782241446.672356:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140065792 00000100:00100000:1.0:1782241446.672387:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782241446.672393:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3640:x1868815140065792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.672425:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3640:x1868815140065792:12345-0@lo:400:kworker.0 Request processed in 32us (6718us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241446.672430:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1782241446.672475:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241446.672480:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782241446.672483:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782241446.672486:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782241446.672518:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3640:1868815140065792:0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.672534:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140066304:0@lo:400:kworker.0 00010000:00080000:1.0:1782241446.672546:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48201c00 x1868815140066816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241446.672556:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140066816:0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.672572:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140065408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241446.672583:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48202d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140065920:0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.672591:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140066432:0@lo:400:kworker.0 00010000:00080000:1.0:1782241446.672601:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48200a80 x1868815140066944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241446.672621:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48200a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815140066944:0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.672673:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140065664:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1782241446.672685:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48200700 x1868815140066176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241446.672693:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48200700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140066176:0@lo:400:kworker.0 00010000:00080000:1.0:1782241446.672703:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48200000 x1868815140066688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241446.672710:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48200000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140066688:0@lo:400:kworker.0 00000100:00100000:1.0:1782241446.672726:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48200e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140065536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782241446.672736:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140066048:0@lo:400:kworker.0 00010000:00080000:1.0:1782241446.672745:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48203b80 x1868815140066560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241446.672752:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48203b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140066560:0@lo:400:kworker.0 00010000:00080000:1.0:1782241446.672798:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d45a4b800 x1868815140067072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241446.672806:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140067072:0@lo:400:kworker.0 00000020:00000004:2.0:1782241447.436251:0:19828:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782241447.436538:0:19828:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782241447.685956:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782241447.691656:0:19368:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:2.0:1782241447.767007:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241447.767282:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120059136 00000100:00100000:0.0:1782241447.767292:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120059136 00000100:00100000:0.0:1782241447.767343:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 116 00000100:00100000:0.0:1782241447.767352:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2395:x1868815120059136:12345-192.168.204.58@tcp:250:mount.lustre.0 00010000:00080000:0.0:1782241447.767387:0:17041:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 1eaa300c-78b6-4e0f-8097-bd653788406c@192.168.204.58@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:0.0:1782241447.767416:0:17041:0:(genops.c:1406:class_connect()) connect: client 1eaa300c-78b6-4e0f-8097-bd653788406c, cookie 0xc9959f2fb1e1ace2 00000100:00080000:0.0:1782241447.767570:0:17041:0:(import.c:65:import_set_state_nolock()) ffff890e7c193000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782241447.767648:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+5:2395:x1868815120059136:12345-192.168.204.58@tcp:250:mount.lustre.0 Request processed in 295us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241447.767656:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 116 00000100:00100000:1.0:1782241447.791407:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241447.793286:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120059264 00000100:00100000:0.0:1782241447.793307:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120059264 00000100:00100000:0.0:1782241447.793406:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 117 00000100:00100000:0.0:1782241447.793420:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+5:14893:x1868815120059264:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782241447.793447:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241447.793507:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4499aa00/0xc9959f2fb1e1ace9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d3335054de expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241447.793546:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4499aa00/0xc9959f2fb1e1ace9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054de expref: 6 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241447.793559:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4499aa00/0xc9959f2fb1e1ace9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054de expref: 6 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241447.793570:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499aa00, rc 0) 00000100:00100000:0.0:1782241447.793665:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+6:14893:x1868815120059264:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 248us (2274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241447.793673:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 117 00000100:00100000:2.0:1782241447.807068:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241447.807873:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120059392 00000100:00100000:1.0:1782241447.807885:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120059392 00000100:00100000:1.0:1782241447.807953:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 118 00000100:00100000:1.0:1782241447.807963:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+6:14893:x1868815120059392:12345-192.168.204.58@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782241447.808120:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+6:14893:x1868815120059392:12345-192.168.204.58@tcp:501:mount.lustre.0 Request processed in 157us (1061us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782241447.808128:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 118 00000100:00100000:2.0:1782241447.810564:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241447.810713:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120059520 00000100:00100000:3.0:1782241447.810725:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120059520 00000100:00100000:3.0:1782241447.810842:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 119 00000100:00100000:3.0:1782241447.810855:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+6:14893:x1868815120059520:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782241447.810878:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241447.810902:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e1acf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d3335054e5 expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241447.810947:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e1acf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054e5 expref: 7 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241447.810961:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164c000/0xc9959f2fb1e1acf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335054e5 expref: 7 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241447.810972:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164c000, rc 0) 00000100:00100000:3.0:1782241447.811045:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+7:14893:x1868815120059520:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 193us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241447.811054:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 119 00000100:00100000:3.0:1782241447.813287:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241447.813396:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120059648 00000100:00100000:0.0:1782241447.813413:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120059648 00000100:00100000:0.0:1782241447.813498:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 120 00000100:00100000:0.0:1782241447.813508:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+7:14893:x1868815120059648:12345-192.168.204.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782241447.813887:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+8:14893:x1868815120059648:12345-192.168.204.58@tcp:501:mount.lustre.0 Request processed in 378us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241447.813895:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 120 00000100:00100000:2.0:1782241447.816055:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241447.817041:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120059776 00000100:00100000:1.0:1782241447.817058:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120059776 00000100:00100000:1.0:1782241447.817332:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 121 00000100:00100000:1.0:1782241447.817345:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+8:14893:x1868815120059776:12345-192.168.204.58@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782241447.817805:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+8:14893:x1868815120059776:12345-192.168.204.58@tcp:503:mount.lustre.0 Request processed in 461us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241447.817818:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 121 00000100:00100000:2.0:1782241447.831511:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241447.831698:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120059904 00000100:00100000:0.0:1782241447.831712:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120059904 00000100:00100000:0.0:1782241447.831835:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 122 00000100:00100000:0.0:1782241447.831848:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+8:14912:x1868815120059904:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782241447.832065:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+8:14912:x1868815120059904:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 218us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241447.832084:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 122 00000100:00100000:3.0:1782241447.870896:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241447.871046:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120060032 00000100:00100000:1.0:1782241447.871058:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120060032 00000100:00100000:1.0:1782241447.871136:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 123 00000100:00100000:1.0:1782241447.871147:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+8:14912:x1868815120060032:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782241447.871379:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+8:14912:x1868815120060032:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 232us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241447.871388:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 123 00000100:00100000:2.0:1782241447.888710:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241447.889568:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120060160 00000100:00100000:3.0:1782241447.889584:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120060160 00000100:00100000:3.0:1782241447.889678:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 124 00000100:00100000:3.0:1782241447.889690:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+8:14912:x1868815120060160:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782241447.890063:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+8:14912:x1868815120060160:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 374us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241447.890071:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 124 00000100:00100000:1.0:1782241447.893720:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241447.894327:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120060288 00000100:00100000:3.0:1782241447.894341:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120060288 00000100:00100000:3.0:1782241447.894418:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 125 00000100:00100000:3.0:1782241447.894430:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+8:14893:x1868815120060288:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782241447.894454:0:17039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241447.894481:0:17039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1acf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d333505516 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241447.894518:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1acf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505516 expref: 9 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241447.894578:0:17039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164d000/0xc9959f2fb1e1acf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505516 expref: 9 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241447.894589:0:17039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d000, rc 0) 00000100:00100000:3.0:1782241447.894692:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+9:14893:x1868815120060288:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 264us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241447.894701:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 125 00000100:00100000:0.0:1782241447.904731:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241447.906482:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120060416 00000100:00100000:1.0:1782241447.906501:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120060416 00000100:00100000:1.0:1782241447.906597:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 126 00000100:00100000:1.0:1782241447.906610:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d46b78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+9:14893:x1868815120060416:12345-192.168.204.58@tcp:256:mount.lustre.0 20000000:01000000:1.0:1782241447.906652:0:17042:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782241447.906693:0:17042:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782241447.906698:0:17042:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782241447.906709:0:17042:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782241447.906712:0:17042:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1782241447.906715:0:17042:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1782241447.910485:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d46b78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+9:14893:x1868815120060416:12345-192.168.204.58@tcp:256:mount.lustre.0 Request processed in 3857us (5762us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241447.910508:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 126 00000100:00100000:2.0:1782241447.913055:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241447.913653:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120060544 00000100:00100000:0.0:1782241447.913668:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120060544 00000100:00100000:0.0:1782241447.913860:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 127 00000100:00100000:0.0:1782241447.913876:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d41936050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+9:14893:x1868815120060544:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782241447.913903:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241447.913938:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4499a600/0xc9959f2fb1e1acfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d33350551d expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241447.913977:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4499a600/0xc9959f2fb1e1acfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350551d expref: 10 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241447.913990:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4499a600/0xc9959f2fb1e1acfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350551d expref: 10 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241447.914001:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499a600, rc 0) 00000100:00100000:0.0:1782241447.914084:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d41936050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+10:14893:x1868815120060544:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 202us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241447.914092:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 127 00000100:00100000:1.0:1782241447.917209:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241447.917400:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120060672 00000100:00100000:2.0:1782241447.917413:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120060672 00000100:00100000:2.0:1782241447.917481:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 128 00000100:00100000:2.0:1782241447.917493:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7d762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+10:14893:x1868815120060672:12345-192.168.204.58@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782241447.917713:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7d762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+10:14893:x1868815120060672:12345-192.168.204.58@tcp:501:mount.lustre.0 Request processed in 221us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241447.917723:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 128 00000100:00100000:2.0:1782241447.919857:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241447.920007:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120060800 00000100:00100000:1.0:1782241447.920020:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120060800 00000100:00100000:1.0:1782241447.920241:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 129 00000100:00100000:1.0:1782241447.920254:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+10:14893:x1868815120060800:12345-192.168.204.58@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782241447.920495:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+10:14893:x1868815120060800:12345-192.168.204.58@tcp:503:mount.lustre.0 Request processed in 243us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241447.920504:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 129 00000100:00100000:1.0:1782241447.924034:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241447.924196:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120060928 00000100:00100000:2.0:1782241447.924210:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120060928 00000100:00100000:2.0:1782241447.924281:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 130 00000100:00100000:2.0:1782241447.924292:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+10:14917:x1868815120060928:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782241447.924581:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+10:14917:x1868815120060928:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 290us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241447.924590:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 130 00000100:00100000:1.0:1782241447.944148:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241447.944269:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120061056 00000100:00100000:0.0:1782241447.944283:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120061056 00000100:00100000:0.0:1782241447.944355:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 131 00000100:00100000:0.0:1782241447.944368:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+10:14917:x1868815120061056:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782241447.944586:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+10:14917:x1868815120061056:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 219us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241447.944595:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 131 00000100:00100000:1.0:1782241447.955687:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241447.955885:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241447.955966:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120061184 00000100:00100000:3.0:1782241447.955980:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120061184 00000100:00100000:0.0:1782241447.956049:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120061440 00000100:00100000:0.0:1782241447.956071:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120061440 00000100:00100000:0.0:1782241447.956136:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:0.0:1782241447.956148:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1868815120061440:12345-192.168.204.58@tcp:38:mount.lustre.0 00010000:00080000:0.0:1782241447.956197:0:17046:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 90b92c6b-99f4-4cbe-a9f0-708a58cf844d@192.168.204.58@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:0.0:1782241447.956269:0:17046:0:(genops.c:1406:class_connect()) connect: client 90b92c6b-99f4-4cbe-a9f0-708a58cf844d, cookie 0xc9959f2fb1e1ad05 00000004:00100000:0.0:1782241447.956306:0:17046:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782241447.956587:0:17046:0:(import.c:65:import_set_state_nolock()) ffff890e7c192000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782241447.956681:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:2395:x1868815120061440:12345-192.168.204.58@tcp:38:mount.lustre.0 Request processed in 532us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241447.956690:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:2.0:1782241447.957003:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 8 00000100:00100000:2.0:1782241447.957012:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1868815120061184:12345-192.168.204.58@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782241447.957031:0:17049:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 90b92c6b-99f4-4cbe-a9f0-708a58cf844d@192.168.204.58@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:2.0:1782241447.957069:0:17049:0:(genops.c:1406:class_connect()) connect: client 90b92c6b-99f4-4cbe-a9f0-708a58cf844d, cookie 0xc9959f2fb1e1ad0c 00000004:00100000:2.0:1782241447.957088:0:17049:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782241447.957256:0:17049:0:(import.c:65:import_set_state_nolock()) ffff890d47566800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782241447.957304:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:2395:x1868815120061184:12345-192.168.204.58@tcp:38:mount.lustre.0 Request processed in 291us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241447.957312:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 8 00000100:00100000:2.0:1782241447.974442:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241447.974494:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241447.974529:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241447.974617:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120061696 00000100:00100000:1.0:1782241447.974630:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120061696 00000100:00100000:3.0:1782241447.974643:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120061568 00000100:00100000:3.0:1782241447.974647:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120061568 00000100:00100000:0.0:1782241447.974708:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120061312 00000100:00100000:0.0:1782241447.974713:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120061312 00000100:00100000:1.0:1782241447.974853:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00100000:1.0:1782241447.974867:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:0:x1868815120061312:12345-192.168.204.58@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782241447.974926:0:17048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1782241447.975009:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00100000:3.0:1782241447.975036:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:14893:x1868815120061696:12345-192.168.204.58@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782241447.975050:0:17049:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:2.0:1782241447.975151:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241447.975156:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241447.975323:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:0:x1868815120061312:12345-192.168.204.58@tcp:41:mount.lustre.0 Request processed in 458us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241447.975332:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00100000:1.0:1782241447.975357:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:1.0:1782241447.975373:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:0:x1868815120061568:12345-192.168.204.58@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782241447.975393:0:17048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1782241447.975432:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:0:x1868815120061568:12345-192.168.204.58@tcp:41:mount.lustre.0 Request processed in 60us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241447.975438:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:2.0:1782241447.975642:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:14893:x1868815120061696:12345-192.168.204.58@tcp:41:mount.lustre.0 Request processed in 605us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241447.975650:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00100000:0.0:1782241447.979201:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241447.979382:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120061824 00000100:00100000:1.0:1782241447.979396:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120061824 00000100:00100000:1.0:1782241447.979480:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:1.0:1782241447.979492:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:14893:x1868815120061824:12345-192.168.204.58@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782241447.979615:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:14893:x1868815120061824:12345-192.168.204.58@tcp:40:mount.lustre.0 Request processed in 124us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241447.979624:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:2.0:1782241447.985540:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241447.985663:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241447.985710:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241447.985832:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120061952 00000100:00100000:1.0:1782241447.985832:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120062080 00000100:00100000:3.0:1782241447.985845:0:19173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120061952 00000100:00100000:1.0:1782241447.985845:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120062080 00000100:00100000:0.0:1782241447.985919:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120062208 00000100:00100000:0.0:1782241447.985924:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120062208 00000100:00100000:3.0:1782241447.985954:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 16 00000100:00100000:3.0:1782241447.985966:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2395:x1868815120061952:12345-192.168.204.58@tcp:8:mount.lustre.0 00000100:00100000:0.0:1782241447.985968:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:0.0:1782241447.985976:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:14893:x1868815120062208:12345-192.168.204.58@tcp:900:mount.lustre.0 00010000:00080000:3.0:1782241447.986009:0:19173:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 90b92c6b-99f4-4cbe-a9f0-708a58cf844d@192.168.204.58@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:3.0:1782241447.986052:0:19173:0:(genops.c:1406:class_connect()) connect: client 90b92c6b-99f4-4cbe-a9f0-708a58cf844d, cookie 0xc9959f2fb1e1ad13 00002000:00100000:3.0:1782241447.986066:0:19173:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 90b92c6b-99f4-4cbe-a9f0-708a58cf844d/ffff890d46713000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782241447.986092:0:19173:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1782241447.986097:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:14893:x1868815120062208:12345-192.168.204.58@tcp:900:mount.lustre.0 Request processed in 100us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241447.986105:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 3 00002000:00080000:0.0:1782241447.986350:0:19173:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782241447.986387:0:19173:0:(import.c:65:import_set_state_nolock()) ffff890e436db800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782241447.986434:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:2395:x1868815120061952:12345-192.168.204.58@tcp:8:mount.lustre.0 Request processed in 470us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241447.986441:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 16 00000100:00100000:0.0:1782241447.986458:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:0.0:1782241447.986463:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2395:x1868815120062080:12345-192.168.204.58@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782241447.986489:0:19173:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 90b92c6b-99f4-4cbe-a9f0-708a58cf844d@192.168.204.58@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:0.0:1782241447.986524:0:19173:0:(genops.c:1406:class_connect()) connect: client 90b92c6b-99f4-4cbe-a9f0-708a58cf844d, cookie 0xc9959f2fb1e1ad1a 00002000:00100000:0.0:1782241447.986530:0:19173:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 90b92c6b-99f4-4cbe-a9f0-708a58cf844d/ffff890e436dc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782241447.986542:0:19173:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782241447.986665:0:19173:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782241447.986684:0:19173:0:(import.c:65:import_set_state_nolock()) ffff890e436da800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782241447.986710:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:2395:x1868815120062080:12345-192.168.204.58@tcp:8:mount.lustre.0 Request processed in 245us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241447.986717:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:2.0:1782241447.990494:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241447.990641:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120062336 00000100:00100000:0.0:1782241447.990654:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120062336 00000100:00100000:0.0:1782241447.990728:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:0.0:1782241447.990749:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:14893:x1868815120062336:12345-192.168.204.58@tcp:33:mount.lustre.0 00000004:00080000:3.0:1782241447.993024:0:17050:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2111us 00000040:00080000:3.0:1782241448.010105:0:17085:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000004:00200000:3.0:1782241448.016522:0:17050:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1782241448.016668:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:14893:x1868815120062336:12345-192.168.204.58@tcp:33:mount.lustre.0 Request processed in 25924us (26181us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241448.016684:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:3.0:1782241448.265682:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241448.265808:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120062464 00000100:00100000:0.0:1782241448.265819:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120062464 00000100:00100000:0.0:1782241448.265889:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:0.0:1782241448.265899:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:14940:x1868815120062464:12345-192.168.204.58@tcp:101:mkdir.0 00010000:00010000:0.0:1782241448.265920:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241448.265950:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a200/0xc9959f2fb1e1ad21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350554e expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241448.266019:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1ad28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241448.266033:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1ad28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241448.266065:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1ad28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241448.266114:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782241448.266118:0:17046:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241448.266150:0:17046:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1ad28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241448.266174:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a200/0xc9959f2fb1e1ad21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350554e expref: 8 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241448.266211:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1ad28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350554e expref: 7 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241448.266220:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195be00) 00010000:00010000:0.0:1782241448.266224:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782241448.266227:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499b200, rc 0) 00000100:00100000:0.0:1782241448.266296:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:14940:x1868815120062464:12345-192.168.204.58@tcp:101:mkdir.0 Request processed in 398us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241448.266304:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 13 00010000:00010000:2.0:1782241448.709291:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241449.734803:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241450.377742:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241450.377907:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120062592 00000100:00100000:2.0:1782241450.377920:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120062592 00000100:00100000:2.0:1782241450.378008:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 14 00000100:00100000:2.0:1782241450.378019:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:14992:x1868815120062592:12345-192.168.204.58@tcp:41:lfs.0 00000004:00000024:2.0:1782241450.378069:0:17048:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1782241450.378183:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:14992:x1868815120062592:12345-192.168.204.58@tcp:41:lfs.0 Request processed in 166us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241450.378191:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 14 00000100:00080000:1.0:1782241450.378376:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241450.383392:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241450.383511:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120062720 00000100:00100000:0.0:1782241450.383524:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120062720 00000100:00100000:0.0:1782241450.383618:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00100000:0.0:1782241450.383632:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:14992:x1868815120062720:12345-192.168.204.58@tcp:41:lfs.0 00000004:00000024:0.0:1782241450.383686:0:17046:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:1.0:1782241450.384042:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782241450.384094:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:14992:x1868815120062720:12345-192.168.204.58@tcp:41:lfs.0 Request processed in 463us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241450.384135:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00100000:0.0:1782241450.388137:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241450.389094:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120062848 00000100:00100000:1.0:1782241450.389113:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120062848 00000100:00100000:1.0:1782241450.389343:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00100000:1.0:1782241450.389356:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4803b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:14992:x1868815120062848:12345-192.168.204.58@tcp:13:lfs.0 00002000:00000024:1.0:1782241450.389403:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1782241450.389542:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4803b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:14992:x1868815120062848:12345-192.168.204.58@tcp:13:lfs.0 Request processed in 188us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241450.389572:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00080000:2.0:1782241450.390902:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241450.392471:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241450.392674:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120062976 00000100:00100000:1.0:1782241450.392686:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120062976 00000100:00100000:1.0:1782241450.392805:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00100000:1.0:1782241450.392817:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:14992:x1868815120062976:12345-192.168.204.58@tcp:13:lfs.0 00002000:00000024:1.0:1782241450.392857:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1782241450.392969:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:14992:x1868815120062976:12345-192.168.204.58@tcp:13:lfs.0 Request processed in 154us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241450.392979:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00080000:2.0:1782241450.394362:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782241450.609290:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241450.617384:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120063104 00000100:00100000:2.0:1782241450.617411:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120063104 00000100:00100000:2.0:1782241450.617508:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 132 00000100:00100000:2.0:1782241450.617522:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+10:15022:x1868815120063104:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782241450.617548:0:17042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241450.617574:0:17042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e43fada00/0xc9959f2fb1e1ad2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d333505555 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241450.617615:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e43fada00/0xc9959f2fb1e1ad2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505555 expref: 11 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241450.617630:0:17042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e43fada00/0xc9959f2fb1e1ad2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505555 expref: 11 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241450.617667:0:17042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fada00, rc 0) 00000100:00100000:2.0:1782241450.617808:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+11:15022:x1868815120063104:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 288us (8544us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241450.617817:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 132 00000100:00100000:0.0:1782241450.631745:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241450.634061:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120063232 00000100:00100000:3.0:1782241450.634095:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120063232 00000100:00100000:3.0:1782241450.634201:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 133 00000100:00100000:3.0:1782241450.634213:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+11:15022:x1868815120063232:12345-192.168.204.58@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782241450.634463:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+11:15022:x1868815120063232:12345-192.168.204.58@tcp:501:mount.lustre.0 Request processed in 250us (2731us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241450.634495:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 133 00000100:00100000:3.0:1782241450.645314:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241450.645435:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120063360 00000100:00100000:0.0:1782241450.645448:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120063360 00000100:00100000:0.0:1782241450.645523:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 134 00000100:00100000:0.0:1782241450.645536:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+11:15022:x1868815120063360:12345-192.168.204.58@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782241450.645947:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+11:15022:x1868815120063360:12345-192.168.204.58@tcp:503:mount.lustre.0 Request processed in 412us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241450.645956:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 134 00000100:00100000:0.0:1782241450.683120:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241450.683300:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120063488 00000100:00100000:2.0:1782241450.683313:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120063488 00000100:00100000:2.0:1782241450.683389:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 135 00000100:00100000:2.0:1782241450.683402:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+11:15031:x1868815120063488:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782241450.683619:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+11:15031:x1868815120063488:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 219us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241450.683628:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 135 00000100:00100000:1.0:1782241450.737846:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241450.743300:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120063616 00000100:00100000:0.0:1782241450.743334:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120063616 00000100:00100000:0.0:1782241450.743459:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 136 00000100:00100000:0.0:1782241450.743476:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+11:15031:x1868815120063616:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782241450.743812:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+11:15031:x1868815120063616:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 339us (5982us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241450.743822:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 136 00000100:00100000:1.0:1782241450.750507:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241450.750874:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120063744 00000100:00100000:3.0:1782241450.750888:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120063744 00000100:00100000:3.0:1782241450.750964:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 137 00000100:00100000:3.0:1782241450.750977:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+11:15031:x1868815120063744:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782241450.751209:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+11:15031:x1868815120063744:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 233us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241450.751218:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 137 00000100:00100000:2.0:1782241450.759065:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140067200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782241450.759201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241450.759444:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140067200 00000100:00100000:1.0:1782241450.759455:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140067200 00000100:00100000:1.0:1782241450.759537:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241450.759549:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140067200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782241450.759582:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1782241450.759640:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140067200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241450.759649:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1782241450.760246:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241450.760355:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00080000:2.0:1782241450.760476:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241450.760530:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140067200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241450.760611:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120063872 00000100:00100000:3.0:1782241450.760619:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120063872 00000100:00100000:3.0:1782241450.760671:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 138 00000100:00100000:3.0:1782241450.760680:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+11:15022:x1868815120063872:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782241450.760706:0:17042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241450.760732:0:17042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164cc00/0xc9959f2fb1e1ad36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d333505586 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241450.760803:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164cc00/0xc9959f2fb1e1ad36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505586 expref: 12 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241450.760815:0:17042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164cc00/0xc9959f2fb1e1ad36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505586 expref: 12 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241450.760827:0:17042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164cc00, rc 0) 00000100:00100000:3.0:1782241450.761023:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+12:15022:x1868815120063872:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 343us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241450.761051:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 138 00000100:00100000:1.0:1782241450.764725:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241450.766344:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120064000 00000100:00100000:0.0:1782241450.766364:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120064000 00000100:00100000:0.0:1782241450.766466:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 139 00000100:00100000:0.0:1782241450.766480:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+12:15022:x1868815120064000:12345-192.168.204.58@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782241450.766519:0:17041:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782241450.766559:0:17041:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782241450.766565:0:17041:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782241450.766569:0:17041:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782241450.766572:0:17041:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1782241450.766574:0:17041:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1782241450.770829:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+12:15022:x1868815120064000:12345-192.168.204.58@tcp:256:mount.lustre.0 Request processed in 4330us (6099us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241450.770850:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 139 00000100:00100000:1.0:1782241450.775399:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241450.775516:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120064128 00000100:00100000:3.0:1782241450.775527:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120064128 00000100:00100000:3.0:1782241450.775901:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 140 00000100:00100000:3.0:1782241450.775916:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+12:15022:x1868815120064128:12345-192.168.204.58@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782241450.775941:0:17042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241450.775969:0:17042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1ad3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d33350558d expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241450.776012:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1ad3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350558d expref: 13 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241450.776027:0:17042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1ad3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350558d expref: 13 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241450.776040:0:17042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d200, rc 0) 00000100:00100000:3.0:1782241450.776498:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+13:15022:x1868815120064128:12345-192.168.204.58@tcp:101:mount.lustre.0 Request processed in 583us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241450.776506:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 140 00000100:00100000:1.0:1782241450.778982:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241450.779274:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120064256 00000100:00100000:0.0:1782241450.779287:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120064256 00000100:00100000:0.0:1782241450.779407:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 141 00000100:00100000:0.0:1782241450.779420:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+13:15022:x1868815120064256:12345-192.168.204.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782241450.779671:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+13:15022:x1868815120064256:12345-192.168.204.58@tcp:501:mount.lustre.0 Request processed in 252us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241450.779680:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 141 00000100:00100000:1.0:1782241450.782803:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241450.782905:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120064384 00000100:00100000:3.0:1782241450.782919:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120064384 00000100:00100000:3.0:1782241450.782995:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 142 00000100:00100000:3.0:1782241450.783008:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+13:15022:x1868815120064384:12345-192.168.204.58@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782241450.783223:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+13:15022:x1868815120064384:12345-192.168.204.58@tcp:503:mount.lustre.0 Request processed in 216us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241450.783233:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 142 00000100:00100000:1.0:1782241450.786404:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241450.786518:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120064512 00000100:00100000:0.0:1782241450.786531:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120064512 00000100:00100000:0.0:1782241450.786602:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 143 00000100:00100000:0.0:1782241450.786614:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+13:15037:x1868815120064512:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782241450.786857:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+13:15037:x1868815120064512:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 244us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241450.786872:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 143 00000100:00100000:1.0:1782241450.800397:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241450.800623:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120064640 00000100:00100000:0.0:1782241450.800637:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120064640 00000100:00100000:0.0:1782241450.800721:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 144 00000100:00100000:0.0:1782241450.800734:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+13:15037:x1868815120064640:12345-192.168.204.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782241450.800985:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+13:15037:x1868815120064640:12345-192.168.204.58@tcp:502:llog_process_th.0 Request processed in 252us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241450.800994:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 144 00000100:00100000:1.0:1782241450.814168:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241450.814312:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241450.814837:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120064768 00000100:00100000:3.0:1782241450.814851:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120064768 00000100:00100000:3.0:1782241450.814915:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120065024 00000100:00100000:3.0:1782241450.814919:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120065024 00000100:00100000:3.0:1782241450.814954:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 16 00000100:00100000:3.0:1782241450.814965:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1868815120064768:12345-192.168.204.58@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782241450.815006:0:19501:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 665bb25c-92e8-4fb6-a390-44e1dde8222e@192.168.204.58@tcp t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:3.0:1782241450.815058:0:19501:0:(genops.c:1406:class_connect()) connect: client 665bb25c-92e8-4fb6-a390-44e1dde8222e, cookie 0xc9959f2fb1e1ad44 00000004:00100000:3.0:1782241450.815094:0:19501:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782241450.815225:0:19501:0:(import.c:65:import_set_state_nolock()) ffff890d46717000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782241450.815314:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2395:x1868815120064768:12345-192.168.204.58@tcp:38:mount.lustre.0 Request processed in 348us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241450.815323:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 16 00000100:00100000:3.0:1782241450.815347:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:3.0:1782241450.815352:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1868815120065024:12345-192.168.204.58@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782241450.815369:0:19501:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 665bb25c-92e8-4fb6-a390-44e1dde8222e@192.168.204.58@tcp t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:3.0:1782241450.815396:0:19501:0:(genops.c:1406:class_connect()) connect: client 665bb25c-92e8-4fb6-a390-44e1dde8222e, cookie 0xc9959f2fb1e1ad4b 00000004:00100000:3.0:1782241450.815411:0:19501:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782241450.815462:0:19501:0:(import.c:65:import_set_state_nolock()) ffff890d46711000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782241450.815487:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2395:x1868815120065024:12345-192.168.204.58@tcp:38:mount.lustre.0 Request processed in 134us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241450.815493:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:1.0:1782241450.829741:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241450.829836:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241450.829933:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241450.830098:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120064896 00000100:00100000:0.0:1782241450.830110:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120064896 00000100:00100000:0.0:1782241450.830213:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120065280 00000100:00100000:0.0:1782241450.830227:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120065280 00000100:00100000:0.0:1782241450.830245:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120065152 00000100:00100000:0.0:1782241450.830248:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120065152 00000100:00100000:0.0:1782241450.830270:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:0.0:1782241450.830281:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+7:0:x1868815120064896:12345-192.168.204.58@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782241450.830333:0:17046:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1782241450.830429:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48203b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+7:0:x1868815120064896:12345-192.168.204.58@tcp:41:mount.lustre.0 Request processed in 149us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241450.830438:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:0.0:1782241450.830458:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:0.0:1782241450.830465:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:15022:x1868815120065280:12345-192.168.204.58@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782241450.830476:0:17046:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1782241450.830497:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:15022:x1868815120065280:12345-192.168.204.58@tcp:41:mount.lustre.0 Request processed in 32us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241450.830503:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:0.0:1782241450.830514:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:0.0:1782241450.830520:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:0:x1868815120065152:12345-192.168.204.58@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782241450.830538:0:17046:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782241450.830565:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:0:x1868815120065152:12345-192.168.204.58@tcp:41:mount.lustre.0 Request processed in 45us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241450.830589:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00080000:1.0:1782241450.831399:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241450.831408:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241450.834554:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241450.834671:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120065408 00000100:00100000:0.0:1782241450.834695:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120065408 00000100:00100000:0.0:1782241450.834808:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:0.0:1782241450.834821:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:15022:x1868815120065408:12345-192.168.204.58@tcp:40:mount.lustre.0 00000100:00100000:0.0:1782241450.834947:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:15022:x1868815120065408:12345-192.168.204.58@tcp:40:mount.lustre.0 Request processed in 128us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241450.834955:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:0.0:1782241450.838168:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241450.838218:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241450.838324:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120065792 00000100:00100000:3.0:1782241450.838337:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120065792 00000100:00100000:3.0:1782241450.838414:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 4 00000100:00100000:3.0:1782241450.838427:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:15022:x1868815120065792:12345-192.168.204.58@tcp:900:mount.lustre.0 00000100:00100000:3.0:1782241450.838555:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:15022:x1868815120065792:12345-192.168.204.58@tcp:900:mount.lustre.0 Request processed in 131us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241450.838562:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 4 00000100:00100000:0.0:1782241450.838819:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241450.843341:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120065536 00000100:00100000:1.0:1782241450.843363:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120065536 00000100:00100000:0.0:1782241450.843593:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241450.843780:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120065920 00000100:00100000:3.0:1782241450.843785:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120065920 00000100:00100000:3.0:1782241450.843833:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 1 00000100:00100000:3.0:1782241450.843844:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:15022:x1868815120065920:12345-192.168.204.58@tcp:33:mount.lustre.0 00000004:00200000:3.0:1782241450.843967:0:17051:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1782241450.844088:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:15022:x1868815120065920:12345-192.168.204.58@tcp:33:mount.lustre.0 Request processed in 232us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241450.844098:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 1 00000100:00100000:1.0:1782241450.844773:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120065664 00000100:00100000:1.0:1782241450.844783:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120065664 00000100:00100000:1.0:1782241450.844826:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:1.0:1782241450.844838:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1868815120065536:12345-192.168.204.58@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782241450.844935:0:18554:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 665bb25c-92e8-4fb6-a390-44e1dde8222e@192.168.204.58@tcp t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:1.0:1782241450.844979:0:18554:0:(genops.c:1406:class_connect()) connect: client 665bb25c-92e8-4fb6-a390-44e1dde8222e, cookie 0xc9959f2fb1e1ad52 00002000:00100000:1.0:1782241450.845170:0:18554:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 665bb25c-92e8-4fb6-a390-44e1dde8222e/ffff890e7c1c8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782241450.845243:0:18554:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782241450.845432:0:18554:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782241450.845477:0:18554:0:(import.c:65:import_set_state_nolock()) ffff890e7c1cd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782241450.845551:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2395:x1868815120065536:12345-192.168.204.58@tcp:8:mount.lustre.0 Request processed in 715us (7331us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241450.846417:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:3.0:1782241450.846429:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1868815120065664:12345-192.168.204.58@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782241450.846470:0:18555:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 665bb25c-92e8-4fb6-a390-44e1dde8222e@192.168.204.58@tcp t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:3.0:1782241450.846510:0:18555:0:(genops.c:1406:class_connect()) connect: client 665bb25c-92e8-4fb6-a390-44e1dde8222e, cookie 0xc9959f2fb1e1ad59 00002000:00100000:3.0:1782241450.846523:0:18555:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 665bb25c-92e8-4fb6-a390-44e1dde8222e/ffff890d46714000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782241450.846535:0:18555:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782241450.846619:0:18555:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782241450.846646:0:18555:0:(import.c:65:import_set_state_nolock()) ffff890e48139000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782241450.846707:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2395:x1868815120065664:12345-192.168.204.58@tcp:8:mount.lustre.0 Request processed in 278us (7887us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241450.846717:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:1.0:1782241450.847590:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:0.0:1782241451.032284:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241451.034301:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120066048 00000100:00100000:3.0:1782241451.034333:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120066048 00000100:00100000:3.0:1782241451.034604:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00100000:3.0:1782241451.034618:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e43f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:15061:x1868815120066048:12345-192.168.204.58@tcp:101:mkdir.0 00010000:00010000:3.0:1782241451.034650:0:19501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241451.034693:0:19501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1ad60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335055be expref: -99 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241451.036589:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ad67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241451.036620:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ad67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241451.036640:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ad67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241451.036720:0:19501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782241451.036725:0:19501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782241451.036804:0:19501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ad67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241451.036850:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1ad60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055be expref: 8 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241451.039280:0:19501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ad67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055be expref: 7 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241451.039500:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195be00) 00010000:00010000:3.0:1782241451.039505:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782241451.039510:0:19501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea600, rc 0) 00000100:00100000:3.0:1782241451.039630:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e43f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:665bb25c-92e8-4fb6-a390-44e1dde8222e+7:15061:x1868815120066048:12345-192.168.204.58@tcp:101:mkdir.0 Request processed in 5013us (7370us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241451.039659:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00100000:1.0:1782241451.269218:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140067328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241451.269333:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241451.269427:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241451.269435:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140067456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241451.269485:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241451.269595:0:18102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140067328 00000100:00100000:0.0:1782241451.269605:0:18102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140067328 00000100:00100000:2.0:1782241451.269747:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140067456 00000100:00100000:2.0:1782241451.269754:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140067456 00000100:00100000:2.0:1782241451.269827:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782241451.269838:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140067328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782241451.269875:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782241451.269940:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140067328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241451.269948:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782241451.269969:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782241451.269984:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140067456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782241451.269998:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1782241451.270031:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140067456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241451.270036:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782241451.271121:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140067456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241451.271146:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140067328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241451.782609:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140067584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241451.782721:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241451.782823:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140067584 00000100:00100000:3.0:1782241451.782833:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140067584 00000100:00100000:3.0:1782241451.783316:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782241451.783329:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140067584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782241451.783372:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1782241451.783624:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140067584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 296us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241451.783632:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1782241451.783662:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782241451.783747:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140067584:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782241451.784351:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241451.784832:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140068096:0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.785628:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241451.785690:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140068608:0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.785723:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241451.785743:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815140069120:0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.785802:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241451.785831:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1782241451.785837:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140067712:0@lo:400:kworker.0 00000100:00100000:2.0:1782241451.785930:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140067840:0@lo:400:kworker.0 00000100:00100000:2.0:1782241451.785969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241451.786006:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140068352:0@lo:400:kworker.0 00000100:00100000:2.0:1782241451.786030:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241451.786048:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815140068864:0@lo:400:kworker.0 00000100:00100000:2.0:1782241451.786070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241451.786087:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140069376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241451.786112:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241451.786538:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241451.786641:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140068224:0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.786680:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241451.786703:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140068736:0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.786727:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241451.786745:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140069248:0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.786803:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241451.787489:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140068096 00000100:00100000:3.0:1782241451.787499:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140068096 00000100:00100000:3.0:1782241451.787646:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140068608 00000100:00100000:3.0:1782241451.787651:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140068608 00000100:00100000:3.0:1782241451.787706:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782241451.787717:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140068096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.787815:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140068096:12345-0@lo:400:kworker.0 Request processed in 99us (2257us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241451.787823:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782241451.788789:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782241451.788804:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140068608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.788881:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140068608:12345-0@lo:400:kworker.0 Request processed in 82us (3157us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241451.790970:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1782241451.791008:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140067968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241451.791104:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241451.791149:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140068480:0@lo:400:kworker.0 00000100:00100000:2.0:1782241451.791174:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241451.791192:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140068992:0@lo:400:kworker.0 00000100:00100000:2.0:1782241451.791218:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241451.791278:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140067840 00000100:00100000:2.0:1782241451.791289:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140067840 00000100:00100000:2.0:1782241451.791348:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140068352 00000100:00100000:2.0:1782241451.791353:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140068352 00000100:00100000:2.0:1782241451.791374:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782241451.791384:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140067840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241451.791493:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140067840:12345-0@lo:400:kworker.0 Request processed in 110us (5522us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241451.791502:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782241451.791524:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782241451.791531:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140068352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241451.791572:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140068352:12345-0@lo:400:kworker.0 Request processed in 41us (5541us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241451.791578:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782241451.791598:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140069376 00000100:00100000:2.0:1782241451.791602:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140069376 00000100:00100000:2.0:1782241451.791621:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140067968 00000100:00100000:2.0:1782241451.791624:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140067968 00000100:00100000:2.0:1782241451.791635:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782241451.791640:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140069376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782241451.791686:0:18557:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782241451.791723:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140069376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (5610us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241451.791729:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782241451.791741:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782241451.791747:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1868815140067968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782241451.791780:0:18557:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782241451.791802:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1868815140067968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241451.791808:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782241451.791828:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140068480 00000100:00100000:2.0:1782241451.791831:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140068480 00000100:00100000:3.0:1782241451.794662:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782241451.794720:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140069120 00000100:00100000:0.0:1782241451.794733:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140069120 00000100:00080000:3.0:1782241451.794741:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782241451.794840:0:3637:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1782241451.795061:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782241451.795078:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140068480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241451.795260:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140068480:12345-0@lo:400:kworker.0 Request processed in 188us (4084us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241451.795269:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782241451.795296:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140068864 00000100:00100000:2.0:1782241451.795301:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140068864 00000100:00100000:2.0:1782241451.795334:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140068224 00000100:00100000:2.0:1782241451.795337:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140068224 00000100:00100000:2.0:1782241451.795349:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140068736 00000100:00100000:2.0:1782241451.795353:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140068736 00000100:00100000:2.0:1782241451.795363:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140069248 00000100:00100000:2.0:1782241451.795366:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140069248 00000100:00100000:2.0:1782241451.795378:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140068992 00000100:00100000:2.0:1782241451.795381:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140068992 00000100:00100000:2.0:1782241451.795393:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782241451.795399:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815140068864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.795516:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140068096:0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.795539:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140068608:0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.795658:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782241451.795679:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140068224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.795731:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140068224:12345-0@lo:400:kworker.0 Request processed in 64us (9049us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241451.795738:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782241451.795754:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782241451.795788:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140068736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.795819:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140068736:12345-0@lo:400:kworker.0 Request processed in 33us (9091us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241451.795827:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782241451.795839:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782241451.796069:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1868815140068864:12345-0@lo:400:kworker.0 Request processed in 668us (9997us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241451.796076:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782241451.796160:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782241451.796169:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140068992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241451.796203:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1868815140068992:12345-0@lo:400:kworker.0 Request processed in 36us (4983us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241451.796208:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782241451.796284:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140067968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782241451.796299:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140068480:0@lo:400:kworker.0 00010000:00080000:2.0:1782241451.796326:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48135180 x1868815140068992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782241451.796337:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1868815140068992:0@lo:400:kworker.0 00000100:00100000:2.0:1782241451.796350:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140067840:0@lo:400:kworker.0 00000100:00100000:2.0:1782241451.796363:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140068352:0@lo:400:kworker.0 00000100:00100000:2.0:1782241451.796376:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1868815140068864:0@lo:400:kworker.0 00000100:00100000:2.0:1782241451.796392:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140069376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241451.796493:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815140069248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.796536:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815140069248:12345-0@lo:400:kworker.0 Request processed in 690us (9731us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241451.796542:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782241451.796655:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140068224:0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.796683:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140068736:0@lo:400:kworker.0 00010000:00080000:3.0:1782241451.796697:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48137100 x1868815140069248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241451.796707:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140069248:0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.796745:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140067712 00000100:00100000:3.0:1782241451.796751:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140067712 00000100:00100000:3.0:1782241451.796836:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782241451.796843:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3637:x1868815140067712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241451.797204:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3637:x1868815140067712:12345-0@lo:400:kworker.0 Request processed in 361us (10664us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241451.797211:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782241451.797269:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140067712:0@lo:400:kworker.0 00000100:00080000:2.0:1782241451.797321:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241451.797327:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782241451.797417:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782241451.797428:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815140069120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241451.797484:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815140069120:12345-0@lo:400:kworker.0 Request processed in 58us (11681us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241451.797492:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782241451.797517:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815140069120:0@lo:400:kworker.0 00000040:00080000:2.0:1782241452.167894:0:17800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782241452.806585:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782241453.834062:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782241453.836460:0:18550:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 665bb25c-92e8-4fb6-a390-44e1dde8222e 00000001:00100000:0.0:1782241453.836474:0:18550:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 90b92c6b-99f4-4cbe-a9f0-708a58cf844d 00000001:00100000:0.0:1782241453.846083:0:17027:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 665bb25c-92e8-4fb6-a390-44e1dde8222e 00000001:00100000:0.0:1782241453.846116:0:17027:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 90b92c6b-99f4-4cbe-a9f0-708a58cf844d 00000001:00100000:1.0:1782241453.850146:0:17780:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 665bb25c-92e8-4fb6-a390-44e1dde8222e 00000001:00100000:1.0:1782241453.850168:0:17780:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 90b92c6b-99f4-4cbe-a9f0-708a58cf844d 00000001:00100000:3.0:1782241453.864369:0:19368:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 665bb25c-92e8-4fb6-a390-44e1dde8222e 00000001:00100000:3.0:1782241453.864388:0:19368:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 90b92c6b-99f4-4cbe-a9f0-708a58cf844d 00000001:02000400:3.0:1782241454.366698:0:19926:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1782241454.854284:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241455.877040:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782241455.877071:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140069504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782241455.877166:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241455.877284:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140069504 00000100:00100000:2.0:1782241455.877294:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140069504 00000100:00100000:2.0:1782241455.877362:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782241455.877374:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140069504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782241455.877413:0:18557:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1782241455.877465:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140069504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241455.877472:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1782241455.877485:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241455.877527:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140069504:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1782241455.882660:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241456.027715:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241456.027782:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241456.027814:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241456.027832:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241456.027848:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241456.027863:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241456.027878:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241456.027896:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241456.027922:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241456.027954:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120066432 00000100:00100000:3.0:1782241456.027966:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120066432 00000100:00100000:3.0:1782241456.028031:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120066944 00000100:00100000:3.0:1782241456.028034:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120066944 00000100:00100000:3.0:1782241456.028049:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120066304 00000100:00100000:3.0:1782241456.028051:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120066304 00000100:00100000:0.0:1782241456.028360:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120066176 00000100:00100000:0.0:1782241456.028366:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120066176 00000100:00100000:0.0:1782241456.028405:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 146 00000100:00100000:0.0:1782241456.028417:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e5060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+13:2399:x1868815120066176:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241456.028511:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e5060d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+13:2399:x1868815120066176:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 96us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241456.028520:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 146 00000100:00100000:0.0:1782241456.028561:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120066688 00000100:00100000:0.0:1782241456.028565:0:19173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120066688 00000100:00100000:0.0:1782241456.028604:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120067200 00000100:00100000:0.0:1782241456.028607:0:19173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120067200 00000100:00100000:0.0:1782241456.028621:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120066560 00000100:00100000:0.0:1782241456.028623:0:19173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120066560 00000100:00100000:0.0:1782241456.028636:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120067072 00000100:00100000:0.0:1782241456.028639:0:19173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120067072 00000100:00100000:0.0:1782241456.028653:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00100000:0.0:1782241456.028659:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120066688:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241456.028688:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120066688:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 30us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241456.028695:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00100000:0.0:1782241456.028708:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00100000:0.0:1782241456.028713:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120067200:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241456.028733:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120067200:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 20us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241456.028739:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00100000:0.0:1782241456.028776:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:0.0:1782241456.028783:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120066560:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241456.028810:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120066560:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 28us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241456.028817:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:0.0:1782241456.028829:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:0.0:1782241456.028835:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120067072:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241456.028857:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120067072:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 22us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241456.028864:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:0.0:1782241456.028882:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120066816 00000100:00100000:0.0:1782241456.028887:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120066816 00000100:00100000:0.0:1782241456.028909:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 44 00000100:00100000:0.0:1782241456.028916:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120066432:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241456.028944:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120066432:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 29us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241456.028951:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 44 00000100:00100000:0.0:1782241456.028964:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 45 00000100:00100000:0.0:1782241456.029123:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120066944:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241456.029153:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120066944:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 182us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241456.029160:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 45 00000100:00100000:3.0:1782241456.029172:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 46 00000100:00100000:0.0:1782241456.029251:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 47 00000100:00100000:3.0:1782241456.029256:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2399:x1868815120066816:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:0.0:1782241456.029258:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:2399:x1868815120066304:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:3.0:1782241456.029559:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2399:x1868815120066816:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 371us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241456.029565:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 46 00000100:00080000:3.0:1782241456.029623:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782241456.029629:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782241456.029631:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782241456.029634:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782241456.029827:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:2399:x1868815120066304:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 33us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241456.029835:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 47 00000100:00100000:3.0:1782241456.389063:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140069632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241456.389138:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241456.389318:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140069632 00000100:00100000:0.0:1782241456.389327:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140069632 00000100:00100000:0.0:1782241456.389390:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782241456.389400:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140069632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241456.389433:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1782241456.389488:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140069632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241456.389496:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782241456.389590:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140069632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782241456.394190:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140069760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241456.394277:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241456.395000:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140069760 00000100:00100000:2.0:1782241456.395009:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140069760 00000100:00100000:2.0:1782241456.395070:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782241456.395078:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140069760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782241456.395112:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782241456.395471:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140069760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 393us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241456.395479:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782241456.402731:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140069760:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1782241456.900926:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241456.901075:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140069888:0@lo:400:kworker.0 00000100:00100000:1.0:1782241456.901193:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241456.901199:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140070016:0@lo:400:kworker.0 00000100:00100000:3.0:1782241456.901248:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241456.901260:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140070400:0@lo:400:kworker.0 00000100:00100000:3.0:1782241456.901277:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140070528:0@lo:400:kworker.0 00000100:00100000:1.0:1782241456.901312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241456.901324:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241456.901353:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815140070912:0@lo:400:kworker.0 00000100:00100000:3.0:1782241456.901356:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140071040:0@lo:400:kworker.0 00000100:00100000:3.0:1782241456.902752:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241456.902927:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140071552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241456.902962:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241456.903014:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140070144:0@lo:400:kworker.0 00000100:00100000:3.0:1782241456.903053:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241456.903076:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140070656:0@lo:400:kworker.0 00000100:00100000:3.0:1782241456.903126:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241456.903145:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140071168:0@lo:400:kworker.0 00000100:00100000:3.0:1782241456.903324:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241456.903733:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140071680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241456.903795:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241456.903827:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1782241456.903834:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140070272:0@lo:400:kworker.0 00000100:00100000:3.0:1782241456.903855:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241456.903872:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140070784:0@lo:400:kworker.0 00000100:00100000:3.0:1782241456.903894:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241456.903925:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815140071296:0@lo:400:kworker.0 00000100:00100000:3.0:1782241456.903949:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241456.904141:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140070400 00000100:00100000:2.0:1782241456.904263:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140070400 00000100:00100000:3.0:1782241456.904389:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140071808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241456.904419:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241456.904612:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140071040 00000100:00100000:2.0:1782241456.904616:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140071040 00000100:00100000:2.0:1782241456.904645:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140071168 00000100:00100000:2.0:1782241456.904649:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140071168 00000100:00100000:2.0:1782241456.904665:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140071296 00000100:00100000:2.0:1782241456.904668:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140071296 00000100:00100000:3.0:1782241456.904727:0:18102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140070016 00000100:00100000:3.0:1782241456.904732:0:18102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140070016 00000100:00100000:3.0:1782241456.904794:0:18102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140070528 00000100:00100000:3.0:1782241456.904797:0:18102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140070528 00000100:00100000:3.0:1782241456.904815:0:18102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782241456.904823:0:18102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140070016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782241456.904891:0:18102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140070016:12345-0@lo:400:kworker.0 Request processed in 68us (3642us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241456.904899:0:18102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782241456.904916:0:18102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782241456.904921:0:18102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140070528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241456.905276:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782241456.905655:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140070400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241456.905710:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48200a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1868815140070400:12345-0@lo:400:kworker.0 Request processed in 428us (4399us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241456.905717:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782241456.905734:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782241456.905741:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815140071040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241456.905794:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815140071040:12345-0@lo:400:kworker.0 Request processed in 53us (3044us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241456.905801:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782241456.905814:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782241456.905820:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140071168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241456.905862:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1868815140071168:12345-0@lo:400:kworker.0 Request processed in 42us (2539us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241456.905882:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782241456.905895:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782241456.905902:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815140071296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241456.905930:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1868815140071296:12345-0@lo:400:kworker.0 Request processed in 30us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241456.905936:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1782241456.905958:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782241456.905962:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782241456.906222:0:18102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140070528:12345-0@lo:400:kworker.0 Request processed in 1299us (4897us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241456.906229:0:18102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782241456.906845:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241456.907427:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140071552 00000100:00100000:3.0:1782241456.907437:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140071552 00000100:00100000:1.0:1782241456.907968:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140071424:0@lo:400:kworker.0 00000100:00100000:1.0:1782241456.908033:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782241456.909013:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241456.909063:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1868815140070400:0@lo:400:kworker.0 00000100:00100000:1.0:1782241456.909118:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140069888 00000100:00100000:1.0:1782241456.909125:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140069888 00000100:00100000:2.0:1782241456.910877:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140070144 00000100:00100000:2.0:1782241456.910893:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140070144 00000100:00100000:2.0:1782241456.910961:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140070656 00000100:00100000:2.0:1782241456.910964:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140070656 00000100:00100000:2.0:1782241456.910977:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140070272 00000100:00100000:2.0:1782241456.910980:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140070272 00000100:00100000:2.0:1782241456.911001:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140070784 00000100:00100000:2.0:1782241456.911004:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140070784 00000100:00100000:2.0:1782241456.911097:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782241456.911112:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815140070144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241456.911230:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1868815140070144:12345-0@lo:400:kworker.0 Request processed in 121us (8175us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241456.911239:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782241456.911261:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782241456.911268:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140070656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241456.911315:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1782241456.911320:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140070656:12345-0@lo:400:kworker.0 Request processed in 52us (8200us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241456.911329:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782241456.911335:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e505a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3639:x1868815140069888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241456.911372:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782241456.911379:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140070272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241456.911415:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140070272:12345-0@lo:400:kworker.0 Request processed in 37us (7559us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241456.911421:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782241456.911432:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782241456.911437:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140070784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241456.911593:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140070784:12345-0@lo:400:kworker.0 Request processed in 154us (7697us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241456.911599:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782241456.911628:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140071680 00000100:00100000:2.0:1782241456.911633:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140071680 00000100:00100000:2.0:1782241456.911653:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140071808 00000100:00100000:2.0:1782241456.911656:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140071808 00000100:00100000:2.0:1782241456.911669:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782241456.911675:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140071680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782241456.911704:0:18557:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782241456.911743:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140071680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (7949us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241456.911751:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782241456.911785:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782241456.911792:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140071808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782241456.911803:0:18557:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782241456.911832:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140071808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (7411us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241456.911838:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782241456.911869:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140070912 00000100:00100000:2.0:1782241456.911873:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140070912 00000100:00100000:2.0:1782241456.911894:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140071424 00000100:00100000:2.0:1782241456.911897:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140071424 00000100:00100000:2.0:1782241456.911913:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782241456.911919:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815140070912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241456.911966:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48201880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1868815140070912:12345-0@lo:400:kworker.0 Request processed in 47us (5123us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241456.911973:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782241456.911985:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782241456.911991:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815140071424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241456.913199:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48202d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1868815140071424:12345-0@lo:400:kworker.0 Request processed in 33us (3991us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241456.913214:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782241456.913516:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e505a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3639:x1868815140069888:12345-0@lo:400:kworker.0 Request processed in 2185us (12320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241456.913527:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782241456.913637:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1868815140070912:0@lo:400:kworker.0 00010000:00080000:1.0:1782241456.913660:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d48039f80 x1868815140071424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241456.913685:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1868815140071424:0@lo:400:kworker.0 00000100:00100000:1.0:1782241456.913700:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140069888:0@lo:400:kworker.0 00000100:00080000:1.0:1782241456.913889:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241456.913897:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782241456.917830:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782241456.917931:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140070272:0@lo:400:kworker.0 00000100:00100000:1.0:1782241456.917995:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140070016:0@lo:400:kworker.0 00000100:00100000:1.0:1782241456.918012:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140070528:0@lo:400:kworker.0 00000100:00100000:1.0:1782241456.918026:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140071040:0@lo:400:kworker.0 00000100:00100000:3.0:1782241456.919157:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140070784:0@lo:400:kworker.0 00000100:00100000:3.0:1782241456.919178:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1868815140071296:0@lo:400:kworker.0 00000100:00100000:3.0:1782241456.919203:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140071808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241456.919219:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140070144:0@lo:400:kworker.0 00000100:00100000:3.0:1782241456.919233:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140070656:0@lo:400:kworker.0 00010000:00080000:3.0:1782241456.919250:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47b4f480 x1868815140071168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782241456.919261:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1868815140071168:0@lo:400:kworker.0 00000100:00100000:3.0:1782241456.919278:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140071680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782241456.919849:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140071552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782241456.919886:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1782241456.920009:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140071552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2163us (17045us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241456.920604:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140071552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782241456.920829:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1782241457.925252:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782241458.113535:0:20074:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe101cde10 20000000:00000080:3.0:1782241458.114100:0:20074:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff890e7c189400 uarg=0000000000000000 20000000:01000000:3.0:1782241458.114161:0:20074:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782241458.114169:0:20074:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782241458.114175:0:20074:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1782241458.115011:0:20075:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1782241458.115269:0:20074:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1782241458.120672:0:20074:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782241458.120719:0:20074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1ad6e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241458.120938:0:20074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1aa03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1a9fc expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241458.120946:0:20074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1aa11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aa0a expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241458.120954:0:20074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e1aa50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aa49 expref: 23 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241458.120961:0:20074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e1aaea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1aae3 expref: 23 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241458.120971:0:20074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e4499a600/0xc9959f2fb1e1acfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350551d expref: 12 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241458.120979:0:20074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1ad3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350558d expref: 12 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241458.120987:0:20074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1ad6e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241458.121430:0:20074:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1ad3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350558d expref: 12 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241458.121468:0:20074:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1ad3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350558d expref: 12 pid: 17042 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241458.121487:0:20074:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20074:1868815140071936:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241458.121675:0:20074:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4499a600/0xc9959f2fb1e1acfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350551d expref: 12 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241458.121684:0:20074:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e4499a600/0xc9959f2fb1e1acfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350551d expref: 12 pid: 17041 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241458.121693:0:20074:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20074:1868815140072064:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241458.121735:0:20074:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e1aaea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1aae3 expref: 23 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241458.121744:0:20074:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e1aaea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aae3 expref: 23 pid: 17042 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241458.121774:0:20074:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20074:1868815140072192:0@lo:104: 00000100:00100000:3.0:1782241458.121826:0:20074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782241458.121882:0:20074:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e1aa50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1aa49 expref: 23 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241458.121890:0:20074:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e1aa50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aa49 expref: 23 pid: 17042 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241458.121898:0:20074:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20074:1868815140072320:0@lo:104: 00000100:00100000:3.0:1782241458.121921:0:20074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782241458.121970:0:20074:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1aa11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1aa0a expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241458.121978:0:20074:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1aa11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aa0a expref: 23 pid: 17041 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241458.121987:0:20074:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20074:1868815140072448:0@lo:104: 00000100:00100000:3.0:1782241458.122008:0:20074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782241458.122035:0:20074:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1aa03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9959f2fb1e1a9fc expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241458.122043:0:20074:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1aa03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a9fc expref: 23 pid: 17041 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241458.122051:0:20074:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20074:1868815140072576:0@lo:104: 00000100:00100000:3.0:1782241458.122069:0:20074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241458.122081:0:20074:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e5219d540 going to sleep for 11 seconds 00000100:00100000:1.0:1782241458.122278:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140072192 00000100:00100000:1.0:1782241458.122287:0:17031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140072192 00000100:00100000:1.0:1782241458.122337:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140072320 00000100:00100000:1.0:1782241458.122340:0:17031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140072320 00000100:00100000:1.0:1782241458.122349:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140072448 00000100:00100000:1.0:1782241458.122351:0:17031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140072448 00000100:00100000:1.0:1782241458.122361:0:17031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140072576 00000100:00100000:1.0:1782241458.122363:0:17031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140072576 00000100:00100000:1.0:1782241458.122377:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782241458.122386:0:17031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+6:20074:x1868815140072192:12345-0@lo:104: 00010000:00010000:1.0:1782241458.122403:0:17031:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e779eba00/0xc9959f2fb1e1aae3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1aaea expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.122480:0:17031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782241458.122487:0:17031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+6:20074:x1868815140072192:12345-0@lo:104: Request processed in 102us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241458.122495:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782241458.122514:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782241458.122521:0:17031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+5:20074:x1868815140072320:12345-0@lo:104: 00010000:00010000:1.0:1782241458.122537:0:17031:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e1aa49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1aa50 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.122579:0:17031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782241458.122584:0:17031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+5:20074:x1868815140072320:12345-0@lo:104: Request processed in 65us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241458.122590:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782241458.122602:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241458.122608:0:17031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+4:20074:x1868815140072448:12345-0@lo:104: 00010000:00010000:1.0:1782241458.122615:0:17031:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e8164ce00/0xc9959f2fb1e1aa0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1aa11 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.122646:0:17031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782241458.122651:0:17031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+4:20074:x1868815140072448:12345-0@lo:104: Request processed in 43us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241458.122657:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241458.122670:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782241458.122676:0:17031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+3:20074:x1868815140072576:12345-0@lo:104: 00010000:00010000:1.0:1782241458.122684:0:17031:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.158@tcp lock: ffff890e4b860400/0xc9959f2fb1e1a9fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1aa03 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.122827:0:17031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1782241458.122833:0:17031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+3:20074:x1868815140072576:12345-0@lo:104: Request processed in 157us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241458.122839:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1782241458.122859:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1782241458.122866:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e779eba00/0xc9959f2fb1e1aae3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1aaea expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.122881:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eba00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241458.122886:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e779eba00/0xc9959f2fb1e1aae3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1aaea expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.122895:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e779eba00/0xc9959f2fb1e1aae3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1aaea expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241458.122902:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e779eba00/0xc9959f2fb1e1aae3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1aaea expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241458.122909:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782241458.122948:0:17036:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e779eba00/0xc9959f2fb1e1aae3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aaea expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.122955:0:17036:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241458.122978:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e779eba00/0xc9959f2fb1e1aae3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aaea expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.122985:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e779eba00/0xc9959f2fb1e1aae3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aaea expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123000:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782241458.123003:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e1aa49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1aa50 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123008:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d600 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241458.123011:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e1aa49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1aa50 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123040:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e1aa49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1aa50 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241458.123048:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e1aa49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1aa50 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241458.123053:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782241458.123067:0:17036:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e1aa49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aa50 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123072:0:17036:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241458.123078:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e1aa49 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aa50 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123085:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164d600/0xc9959f2fb1e1aa49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aa50 expref: -99 pid: 18549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123095:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782241458.123097:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e8164ce00/0xc9959f2fb1e1aa0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1aa11 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123103:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164ce00 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241458.123105:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e8164ce00/0xc9959f2fb1e1aa0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1aa11 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123112:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e8164ce00/0xc9959f2fb1e1aa0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1aa11 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241458.123118:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e8164ce00/0xc9959f2fb1e1aa0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1aa11 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241458.123128:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782241458.123141:0:17036:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e8164ce00/0xc9959f2fb1e1aa0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aa11 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123148:0:17036:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241458.123165:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e8164ce00/0xc9959f2fb1e1aa0a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aa11 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123171:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e8164ce00/0xc9959f2fb1e1aa0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aa11 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123182:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241458.123184:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.158@tcp lock: ffff890e4b860400/0xc9959f2fb1e1a9fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9959f2fb1e1aa03 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123190:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4b860400 already unused, calling callback (ffffffffc12aac20) 10000000:00010000:1.0:1782241458.123193:0:17036:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860400/0xc9959f2fb1e1a9fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9959f2fb1e1aa03 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123200:0:17036:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.158@tcp lock: ffff890e4b860400/0xc9959f2fb1e1a9fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9959f2fb1e1aa03 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782241458.123206:0:17036:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.158@tcp lock: ffff890e4b860400/0xc9959f2fb1e1a9fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9959f2fb1e1aa03 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241458.123212:0:17036:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782241458.123224:0:17036:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.158@tcp lock: ffff890e4b860400/0xc9959f2fb1e1a9fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aa03 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123230:0:17036:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782241458.123242:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.158@tcp lock: ffff890e4b860400/0xc9959f2fb1e1a9fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aa03 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123249:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.158@tcp lock: ffff890e4b860400/0xc9959f2fb1e1a9fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9959f2fb1e1aa03 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123265:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241458.123266:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241458.123268:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241458.123277:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241458.123284:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241458.123299:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140072704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782241458.123339:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241458.123374:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241458.123380:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140072832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782241458.123403:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241458.123429:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140072960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782241458.123450:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241458.123465:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782241458.123470:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140073088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782241458.123490:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241458.123513:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140072704 00000100:00100000:1.0:1782241458.123519:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140072704 00010000:00010000:1.0:1782241458.123554:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e1aaea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aae3 expref: 24 pid: 17042 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241458.123574:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140072832 00000100:00100000:1.0:1782241458.123576:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140072832 00010000:00010000:1.0:1782241458.123586:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e1aa50 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aa49 expref: 25 pid: 17042 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241458.123605:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140072960 00000100:00100000:1.0:1782241458.123607:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140072960 00010000:00010000:1.0:1782241458.123618:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1aa11 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aa0a expref: 26 pid: 17041 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241458.123626:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140073088 00000100:00100000:1.0:1782241458.123628:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140073088 00010000:00010000:1.0:1782241458.123636:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1aa03 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a9fc expref: 27 pid: 17041 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241458.123647:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782241458.123653:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+27:3639:x1868815140072704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241458.123664:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241458.123670:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e1aaea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aae3 expref: 27 pid: 17042 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123680:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e1aaea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aae3 expref: 27 pid: 17042 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.123699:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241458.123892:0:17033:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1782241458.123904:0:17033:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1782241458.123922:0:17034:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1782241458.123931:0:17034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782241458.123938:0:17034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+27:3639:x1868815140072832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782241458.123948:0:17034:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241458.123953:0:17034:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e1aa50 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aa49 expref: 27 pid: 17042 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.123961:0:17034:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e1aa50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aa49 expref: 27 pid: 17042 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.123971:0:17034:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782241458.124093:0:20074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e778f1e00/0xc9959f2fb1e1aaea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1aae3 expref: 27 pid: 17042 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241458.124106:0:20074:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20074:1868815140072192:0@lo:104: 00010000:00010000:3.0:1782241458.124117:0:20074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4b861200/0xc9959f2fb1e1aa50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1aa49 expref: 26 pid: 17042 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241458.124126:0:20074:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20074:1868815140072320:0@lo:104: 00000100:00100000:3.0:1782241458.124133:0:20074:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20074:1868815140072448:0@lo:104: 00000100:00100000:3.0:1782241458.124141:0:20074:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20074:1868815140072576:0@lo:104: 00000100:00100000:1.0:1782241458.124211:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+25:3639:x1868815140072704:12345-0@lo:103:ldlm_bl.0 Request processed in 557us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241458.124219:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782241458.124237:0:17032:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1782241458.124244:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241458.124250:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3637:x1868815140072960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241458.124258:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241458.124263:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1aa11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aa0a expref: 24 pid: 17041 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.124277:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1aa11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1aa0a expref: 24 pid: 17041 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.124287:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779eb800/0xc9959f2fb1e1aa11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1aa0a expref: 24 pid: 17041 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.124296:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241458.124331:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:3637:x1868815140072960:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241458.124337:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782241458.124349:0:17032:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1782241458.124354:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782241458.124360:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:3637:x1868815140073088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782241458.124367:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241458.124372:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1aa03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a9fc expref: 22 pid: 17041 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.124379:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1aa03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9959f2fb1e1a9fc expref: 22 pid: 17041 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.124388:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779eb000/0xc9959f2fb1e1aa03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9959f2fb1e1a9fc expref: 22 pid: 17041 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.124395:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241458.124416:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:3637:x1868815140073088:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241458.124422:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782241458.124477:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48202a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140073088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241458.124486:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48202300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140072960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782241458.125668:0:17034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:3639:x1868815140072832:12345-0@lo:103:ldlm_bl.0 Request processed in 1725us (2259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241458.125678:0:17034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782241458.125928:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140072832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782241458.125949:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48201500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3639:1868815140072704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782241458.133456:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241458.133507:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241458.133608:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120067328 00000100:00100000:2.0:1782241458.133620:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120067328 00010000:00010000:2.0:1782241458.133681:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1ad3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350558d expref: 13 pid: 17042 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241458.133725:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120067456 00000100:00100000:2.0:1782241458.133738:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120067456 00010000:00010000:2.0:1782241458.133787:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff890e4499a600/0xc9959f2fb1e1acfe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350551d expref: 14 pid: 17041 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241458.133816:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:2.0:1782241458.133827:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d41937850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eaa300c-78b6-4e0f-8097-bd653788406c+14:2398:x1868815120067328:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241458.133847:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241458.133854:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1ad3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350558d expref: 14 pid: 17042 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.133867:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1ad3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350558d expref: 14 pid: 17042 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.133890:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e8164d200/0xc9959f2fb1e1ad3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350558d expref: 14 pid: 17042 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.133910:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241458.133974:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d41937850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eaa300c-78b6-4e0f-8097-bd653788406c+13:2398:x1868815120067328:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 148us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241458.133983:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:1.0:1782241458.134019:0:20074:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20074:1868815140071936:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241458.134041:0:20074:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20074:1868815140072064:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241458.134089:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 14 00010000:00010000:1.0:1782241458.134095:0:20074:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1ad6e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241458.134099:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eaa300c-78b6-4e0f-8097-bd653788406c+12:2398:x1868815120067456:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241458.134112:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241458.134118:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff890e4499a600/0xc9959f2fb1e1acfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350551d expref: 12 pid: 17041 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.134129:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff890e4499a600/0xc9959f2fb1e1acfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350551d expref: 12 pid: 17041 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.134139:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e4499a600/0xc9959f2fb1e1acfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350551d expref: 12 pid: 17041 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.134152:0:17032:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1ad6e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.134161:0:17032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1ad6e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.134178:0:17032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1ad6e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.134185:0:17032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1ad6e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.134193:0:17032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1ad6e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.134199:0:17032:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1ad6e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.134205:0:17032:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ebe00 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241458.134216:0:17032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1ad6e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.134225:0:17032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1ad6e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.134241:0:17032:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1ad6e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241458.134251:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241458.134272:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eaa300c-78b6-4e0f-8097-bd653788406c+11:2398:x1868815120067456:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 175us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241458.134280:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 14 00010000:00010000:1.0:1782241458.134315:0:20074:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1ad6e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.134324:0:20074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1ad6e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241458.134340:0:20074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff890e779ebe00/0xc9959f2fb1e1ad6e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782241458.245472:0:17085:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782241458.948981:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241459.297203:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241459.297242:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120067584 00000100:00100000:1.0:1782241459.297252:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120067584 00000100:00100000:1.0:1782241459.297302:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 148 00000100:00100000:1.0:1782241459.297314:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e505a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+11:14908:x1868815120067584:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241459.297332:0:17042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241459.297351:0:17042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e821c2000/0xc9959f2fb1e1ad75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d3335055c5 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.297378:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e821c2000/0xc9959f2fb1e1ad75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055c5 expref: 12 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.297402:0:17042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e821c2000/0xc9959f2fb1e1ad75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055c5 expref: 12 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.297412:0:17042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e821c2000, rc 0) 00000100:00100000:1.0:1782241459.297468:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e505a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+12:14908:x1868815120067584:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 Request processed in 157us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241459.297475:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 148 00000100:00100000:1.0:1782241459.303339:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241459.303887:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120067712 00000100:00100000:2.0:1782241459.303898:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120067712 00000100:00100000:2.0:1782241459.304010:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 149 00000100:00100000:2.0:1782241459.304022:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e505a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+12:14908:x1868815120067712:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241459.304318:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e505a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+12:14908:x1868815120067712:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 Request processed in 297us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241459.304328:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 149 00000100:00100000:1.0:1782241459.311304:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241459.311376:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120067840 00000100:00100000:2.0:1782241459.311386:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120067840 00000100:00100000:2.0:1782241459.311449:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 150 00000100:00100000:2.0:1782241459.311459:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e505a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+12:14908:x1868815120067840:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782241459.311619:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e505a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+12:14908:x1868815120067840:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 Request processed in 159us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241459.311628:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 150 00000100:00100000:2.0:1782241459.317824:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241459.317899:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120067968 00000100:00100000:3.0:1782241459.317909:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120067968 00000100:00100000:3.0:1782241459.317972:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 151 00000100:00100000:3.0:1782241459.317982:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e820d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+12:14908:x1868815120067968:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241459.318002:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241459.318022:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ad7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a2492d3335055cc expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241459.318201:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ad7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055cc expref: 13 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241459.318214:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e779ea400/0xc9959f2fb1e1ad7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055cc expref: 13 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241459.318224:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e779ea400, rc 0) 00000100:00100000:3.0:1782241459.318288:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e820d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+13:14908:x1868815120067968:12345-192.168.204.58@tcp:101:ll_cfg_requeue.0 Request processed in 307us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241459.318295:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 151 00000100:00100000:3.0:1782241459.322744:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241459.323381:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120068096 00000100:00100000:0.0:1782241459.323391:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120068096 00000100:00100000:0.0:1782241459.323487:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 152 00000100:00100000:0.0:1782241459.323498:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e820d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+13:14908:x1868815120068096:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241459.323670:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e820d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+13:14908:x1868815120068096:12345-192.168.204.58@tcp:501:ll_cfg_requeue.0 Request processed in 172us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241459.323679:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 152 00000100:00100000:2.0:1782241459.334884:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241459.335341:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120068224 00000100:00100000:3.0:1782241459.335352:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120068224 00000100:00100000:3.0:1782241459.335401:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 153 00000100:00100000:3.0:1782241459.335411:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4c44c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+13:14908:x1868815120068224:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241459.335566:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4c44c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1eaa300c-78b6-4e0f-8097-bd653788406c+13:14908:x1868815120068224:12345-192.168.204.58@tcp:503:ll_cfg_requeue.0 Request processed in 155us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241459.335584:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 153 10000000:01000000:3.0:1782241459.781804:0:17044:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782241459.781812:0:17044:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e436de000 from 13 10000000:01000000:3.0:1782241459.781817:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782241459.781861:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241459.781872:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241459.781883:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241459.781909:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140073216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782241459.781979:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241459.782023:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782241459.782136:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140073216 00000100:00100000:0.0:1782241459.782143:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140073216 00000100:00100000:0.0:1782241459.782199:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782241459.782209:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4c44c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+20:17044:x1868815140073216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241459.782224:0:17042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241459.782242:0:17042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e4499bc00/0xc9959f2fb1e1ad8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1ad83 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241459.782273:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e4499bc00/0xc9959f2fb1e1ad8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1ad83 expref: 21 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241459.782284:0:17042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e4499bc00/0xc9959f2fb1e1ad8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1ad83 expref: 21 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241459.782292:0:17042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499bc00, rc 0) 00000100:00100000:0.0:1782241459.782344:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4c44c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:17044:x1868815140073216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241459.782350:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1782241459.782435:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140073216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241459.782450:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ad8a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.782459:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1ad8a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241459.782528:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140073344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241459.782556:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241459.782578:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241459.782620:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140073344 00000100:00100000:0.0:1782241459.782625:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140073344 00000100:00100000:0.0:1782241459.782655:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782241459.782662:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4c44e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:17044:x1868815140073344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241459.782788:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4c44e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:17044:x1868815140073344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241459.782795:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1782241459.782931:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140073344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241459.782974:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140073472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782241459.783011:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241459.783113:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782241459.783174:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140073472 00000100:00100000:0.0:1782241459.783178:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140073472 00000100:00100000:0.0:1782241459.783208:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782241459.783215:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e4c44e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:17044:x1868815140073472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241459.783298:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e4c44e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:17044:x1868815140073472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241459.783305:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1782241459.783403:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140073472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782241459.784316:0:20156:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1782241459.785994:0:17044:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1782241459.786023:0:17044:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782241459.786036:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ad8a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241459.786116:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e779eb000/0xc9959f2fb1e1ad83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ad8a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782241459.786126:0:17044:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782241459.786129:0:17044:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890e8140e800 from 13 10000000:01000000:3.0:1782241459.786131:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782241459.786166:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241459.786188:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241459.786200:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241459.786223:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140073600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782241459.786285:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241459.786363:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47b85cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241459.790716:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140073600 00000100:00100000:1.0:1782241459.790729:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140073600 00000100:00100000:1.0:1782241459.790797:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782241459.790808:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+21:17044:x1868815140073600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241459.790825:0:17042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241459.790843:0:17042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e821c2200/0xc9959f2fb1e1ad98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1ad91 expref: -99 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.790872:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e821c2200/0xc9959f2fb1e1ad98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1ad91 expref: 22 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.790883:0:17042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e821c2200/0xc9959f2fb1e1ad98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1ad91 expref: 22 pid: 17042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.790891:0:17042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e821c2200, rc 0) 00000100:00100000:1.0:1782241459.790976:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:17044:x1868815140073600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (4690us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241459.790985:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782241459.791123:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140073600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782241459.791153:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ad98 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241459.791163:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1ad98 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241459.791237:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140073728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241459.791272:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241459.791311:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4898cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241459.791353:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140073728 00000100:00100000:1.0:1782241459.791357:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140073728 00000100:00100000:1.0:1782241459.791417:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782241459.791425:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:17044:x1868815140073728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241459.791543:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:17044:x1868815140073728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241459.791550:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782241459.794521:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140073728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782241459.794588:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140073856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782241459.794659:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241459.794690:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e4898cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782241459.795673:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140073856 00000100:00100000:1.0:1782241459.795685:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140073856 00000100:00100000:1.0:1782241459.795743:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782241459.795752:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:17044:x1868815140073856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782241459.795892:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:17044:x1868815140073856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241459.795900:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782241459.796029:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7f684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140073856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782241459.796730:0:20160:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1782241459.796799:0:17044:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1782241459.796819:0:17044:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782241459.796830:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ad98 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.796840:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e779ebe00/0xc9959f2fb1e1ad91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ad98 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782241459.796850:0:17044:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782241459.796852:0:17044:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890d48032000 from 13 10000000:01000000:1.0:1782241459.796855:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782241459.796882:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.796890:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.796898:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241459.796917:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140073984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782241459.796959:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241459.796994:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241459.797008:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140073984 00000100:00100000:1.0:1782241459.797012:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140073984 00000100:00100000:1.0:1782241459.797037:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782241459.797113:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+22:17044:x1868815140073984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241459.797123:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241459.797134:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e821c3800/0xc9959f2fb1e1ada6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1ad9f expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.797154:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e821c3800/0xc9959f2fb1e1ada6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1ad9f expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.797163:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e821c3800/0xc9959f2fb1e1ada6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1ad9f expref: 23 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.797171:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e821c3800, rc 0) 00000100:00100000:1.0:1782241459.797198:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:17044:x1868815140073984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241459.797204:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782241459.797236:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140073984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241459.797248:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ada6 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.797256:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1ada6 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241459.797294:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140074112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241459.797318:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241459.797339:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241459.797351:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140074112 00000100:00100000:1.0:1782241459.797354:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140074112 00000100:00100000:1.0:1782241459.797377:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782241459.797384:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:17044:x1868815140074112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241459.797481:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:17044:x1868815140074112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241459.797487:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782241459.797529:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140074112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782241459.797552:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140074240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782241459.797585:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241459.797598:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241459.797609:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140074240 00000100:00100000:1.0:1782241459.797612:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140074240 00000100:00100000:1.0:1782241459.797633:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782241459.797639:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:17044:x1868815140074240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782241459.797710:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:17044:x1868815140074240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241459.797716:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782241459.797778:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d48039f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140074240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782241459.798871:0:20161:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1782241459.799024:0:17044:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1782241459.799111:0:17044:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782241459.799121:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ada6 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241459.799130:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e821c3200/0xc9959f2fb1e1ad9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1ada6 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782241459.799139:0:17044:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782241459.799141:0:17044:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff890d48284800 from 13 10000000:01000000:2.0:1782241459.799144:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782241459.799171:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241459.799179:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241459.799188:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241459.799207:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140074368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782241459.799250:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241459.799318:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df56300 going to sleep for 11 seconds 00000100:00100000:1.0:1782241459.799355:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140074368 00000100:00100000:1.0:1782241459.799361:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140074368 00000100:00100000:1.0:1782241459.799434:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1782241459.799444:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+23:17044:x1868815140074368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782241459.799454:0:17041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241459.799474:0:17041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff890e821c2800/0xc9959f2fb1e1adb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9959f2fb1e1adad expref: -99 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.799496:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff890e821c2800/0xc9959f2fb1e1adb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9959f2fb1e1adad expref: 24 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.799506:0:17041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff890e821c2800/0xc9959f2fb1e1adb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9959f2fb1e1adad expref: 24 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241459.799527:0:17041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e821c2800, rc 0) 00000100:00100000:1.0:1782241459.799576:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:17044:x1868815140074368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241459.799584:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1782241459.799654:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140074368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782241459.799668:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1adb4 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241459.799677:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9959f2fb1e1adb4 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241459.799730:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140074496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241459.799788:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241459.799930:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f8f300 going to sleep for 11 seconds 00000100:00100000:2.0:1782241459.799961:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140074496 00000100:00100000:2.0:1782241459.799965:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140074496 00000100:00100000:2.0:1782241459.799990:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1782241459.799997:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:17044:x1868815140074496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782241459.800257:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:17044:x1868815140074496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241459.800271:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1782241459.800325:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140074496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782241459.800354:0:17044:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140074624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782241459.800391:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241459.800443:0:17044:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e42f8f300 going to sleep for 11 seconds 00000100:00100000:1.0:1782241459.800469:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140074624 00000100:00100000:1.0:1782241459.800473:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140074624 00000100:00100000:1.0:1782241459.800541:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1782241459.800549:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:17044:x1868815140074624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782241459.800657:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:17044:x1868815140074624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241459.800665:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1782241459.800738:0:17044:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:17044:1868815140074624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782241459.801946:0:20163:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1782241459.802299:0:17044:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1782241459.802319:0:17044:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782241459.802329:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1adb4 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241459.802339:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.158@tcp lock: ffff890e43facc00/0xc9959f2fb1e1adad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9959f2fb1e1adb4 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241459.974175:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241460.996962:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241460.997562:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782241460.997585:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140074752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241460.997652:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241460.997852:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140074752 00000100:00100000:2.0:1782241460.997859:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140074752 00000100:00100000:2.0:1782241460.997927:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782241460.997937:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140074752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782241460.997976:0:18557:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1782241460.998022:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140074752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241460.998029:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782241460.998416:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4676e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140074752:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1782241460.998655:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241461.174784:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.174836:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.174872:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.174907:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.174927:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.174951:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.174972:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.174990:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.175015:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241461.175370:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120068480 00000100:00100000:1.0:1782241461.175379:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120068480 00000100:00100000:1.0:1782241461.175436:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120068608 00000100:00100000:1.0:1782241461.175440:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120068608 00000100:00100000:1.0:1782241461.175453:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120068992 00000100:00100000:1.0:1782241461.175455:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120068992 00000100:00100000:1.0:1782241461.175465:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120069120 00000100:00100000:1.0:1782241461.175467:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120069120 00000100:00100000:1.0:1782241461.175493:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 54 00000100:00100000:1.0:1782241461.175516:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:2399:x1868815120068480:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241461.175590:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:2399:x1868815120068480:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 75us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241461.175598:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 54 00000100:00100000:1.0:1782241461.175615:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 55 00000100:00100000:1.0:1782241461.175621:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120068608:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241461.175645:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120068608:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 24us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241461.175664:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 55 00000100:00100000:1.0:1782241461.175677:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 56 00000100:00100000:1.0:1782241461.175684:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2399:x1868815120068992:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241461.175707:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2399:x1868815120068992:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 24us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241461.175714:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 56 00000100:00100000:1.0:1782241461.175725:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 57 00000100:00100000:1.0:1782241461.175732:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120069120:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241461.175753:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120069120:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 22us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241461.175790:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 57 00000100:00100000:2.0:1782241461.176497:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120068352 00000100:00100000:2.0:1782241461.176503:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120068352 00000100:00100000:2.0:1782241461.176548:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 166 00000100:00100000:2.0:1782241461.176556:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+13:2399:x1868815120068352:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241461.176586:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1eaa300c-78b6-4e0f-8097-bd653788406c+13:2399:x1868815120068352:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 32us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241461.176594:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 166 00000100:00100000:2.0:1782241461.176625:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120068736 00000100:00100000:2.0:1782241461.176629:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120068736 00000100:00100000:2.0:1782241461.176670:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120068864 00000100:00100000:2.0:1782241461.176681:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120068864 00000100:00100000:2.0:1782241461.176697:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120069248 00000100:00100000:2.0:1782241461.176699:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120069248 00000100:00100000:2.0:1782241461.176710:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120069376 00000100:00100000:2.0:1782241461.176712:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120069376 00000100:00100000:2.0:1782241461.176726:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:2.0:1782241461.176732:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120068736:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241461.176785:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120068736:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 52us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241461.176791:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:2.0:1782241461.176803:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:2.0:1782241461.176809:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120068864:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241461.176831:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120068864:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 23us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241461.176838:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:2.0:1782241461.176848:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:2.0:1782241461.176855:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120069248:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241461.176876:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120069248:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 22us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241461.176883:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:2.0:1782241461.176894:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:2.0:1782241461.176899:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120069376:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241461.176914:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120069376:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 16us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241461.176919:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00080000:0.0:1782241461.177607:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782241461.177612:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782241461.177614:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782241461.177617:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782241461.325028:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241461.325145:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120069504 00000100:00100000:1.0:1782241461.325155:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120069504 00000100:00100000:1.0:1782241461.325222:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:1.0:1782241461.325232:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:15577:x1868815120069504:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782241461.325269:0:17048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241461.325293:0:17048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1adbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335055d3 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325359:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1adc2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325373:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1adc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325384:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1adc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325398:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1adc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325405:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1adc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325412:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1adc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325505:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031200/0xc9959f2fb1e1add0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325513:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031200/0xc9959f2fb1e1add0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325520:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031200/0xc9959f2fb1e1add0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241461.325550:0:17048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782241461.325571:0:17048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241461.325609:0:17048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031200/0xc9959f2fb1e1add0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325620:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1adc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325626:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1adc2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325632:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1adc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325638:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40031e00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241461.325642:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1adc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325650:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1adc2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325663:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195be00) 00010000:00010000:1.0:1782241461.325667:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241461.325671:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1adc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325677:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1adc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325692:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1adc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325698:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1adc9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325714:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1adc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325720:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40030600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241461.325723:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1adc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325730:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1adc9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325738:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff890e81803000) 00010000:00010000:1.0:1782241461.325741:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241461.325743:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1adc9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325749:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1adc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325840:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1adbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055d3 expref: 8 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325854:0:17048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031200/0xc9959f2fb1e1add0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055d3 expref: 7 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.325861:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff890e81803400) 00010000:00010000:1.0:1782241461.325863:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782241461.325866:0:17048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e40031200, rc 0) 00000100:00100000:1.0:1782241461.325929:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:15577:x1868815120069504:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 698us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241461.325946:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:2.0:1782241461.339011:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241461.339282:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120069632 00000100:00100000:3.0:1782241461.339292:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120069632 00000100:00100000:3.0:1782241461.339410:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:3.0:1782241461.339422:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:15577:x1868815120069632:12345-192.168.204.58@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1782241461.339542:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:15577:x1868815120069632:12345-192.168.204.58@tcp:900:lhsmtool_posix.0 Request processed in 122us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241461.339551:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:3.0:1782241461.350593:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241461.352552:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120069888 00000100:00100000:1.0:1782241461.352566:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120069888 00000100:00100000:0.0:1782241461.352822:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:0.0:1782241461.352835:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:15577:x1868815120069888:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782241461.352857:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241461.352877:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b400/0xc9959f2fb1e1add7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335055da expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.352966:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1adde lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.352981:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1adde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.352991:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1adde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353051:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ade5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353059:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ade5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353065:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ade5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353187:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a400/0xc9959f2fb1e1adec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353195:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a400/0xc9959f2fb1e1adec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353464:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a400/0xc9959f2fb1e1adec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241461.353504:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1782241461.353744:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1adde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353751:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1adde lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353782:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1adde lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353787:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499ba00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241461.353792:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1adde lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353798:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1adde lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353810:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff890e81803400) 00010000:00010000:0.0:1782241461.353813:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241461.353818:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1adde lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353824:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1adde lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353836:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ade5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353842:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ade5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353858:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ade5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353864:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499ac00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241461.353867:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ade5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353872:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ade5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353880:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff890d4195b300) 00010000:00010000:0.0:1782241461.353882:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241461.353885:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ade5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.353890:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ade5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.355342:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b400/0xc9959f2fb1e1add7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055da expref: 10 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.355378:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a400/0xc9959f2fb1e1adec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055da expref: 9 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.355390:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890d4195bf00) 00010000:00010000:0.0:1782241461.355393:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241461.355397:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499a400, rc 0) 00000100:00100000:0.0:1782241461.355512:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+9:15577:x1868815120069888:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 2678us (4924us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1782241461.355541:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:1.0:1782241461.361908:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.362535:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120070016 00000100:00100000:0.0:1782241461.362553:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120070016 00000100:00100000:0.0:1782241461.362709:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:0.0:1782241461.362723:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+9:15577:x1868815120070016:12345-192.168.204.58@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1782241461.362898:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+9:15577:x1868815120070016:12345-192.168.204.58@tcp:59:lhsmtool_posix.0 Request processed in 178us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241461.362921:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:2.0:1782241461.375274:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241461.375390:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120070144 00000100:00100000:3.0:1782241461.375474:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120070144 00000100:00100000:3.0:1782241461.375565:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 26 00000100:00100000:3.0:1782241461.375576:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:15577:x1868815120070144:12345-192.168.204.58@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1782241461.382066:0:17049:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6444us 00000100:00100000:0.0:1782241461.406199:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:15577:x1868815120070144:12345-192.168.204.58@tcp:59:lhsmtool_posix.0 Request processed in 30615us (30934us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241461.406214:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 26 00000100:00100000:0.0:1782241461.446626:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241461.446720:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120070272 00000100:00100000:2.0:1782241461.446729:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120070272 00000100:00100000:2.0:1782241461.446803:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 27 00000100:00100000:2.0:1782241461.446813:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+9:15583:x1868815120070272:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:2.0:1782241461.446832:0:19501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241461.446851:0:19501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1adfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335055e1 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.446908:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad800/0xc9959f2fb1e1ae01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.446922:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad800/0xc9959f2fb1e1ae01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.446934:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad800/0xc9959f2fb1e1ae01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.446947:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1ae08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.446954:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1ae08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.446960:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1ae08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447000:0:19501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad800/0xc9959f2fb1e1ae01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447019:0:19501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad800/0xc9959f2fb1e1ae01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447026:0:19501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad800/0xc9959f2fb1e1ae01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447031:0:19501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241461.447035:0:19501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad800/0xc9959f2fb1e1ae01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447043:0:19501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad800/0xc9959f2fb1e1ae01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447054:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195be00) 00010000:00010000:2.0:1782241461.447057:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241461.447061:0:19501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad800/0xc9959f2fb1e1ae01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447067:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad800/0xc9959f2fb1e1ae01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447078:0:19501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1ae08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447085:0:19501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1ae08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447091:0:19501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1ae08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447096:0:19501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241461.447102:0:19501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1ae08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447108:0:19501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1ae08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447115:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff890e45e7a300) 00010000:00010000:2.0:1782241461.447117:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241461.447120:0:19501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1ae08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447125:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1ae08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447153:0:19501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1adfa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055e1 expref: 10 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447162:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195be00) 00010000:00010000:2.0:1782241461.447164:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241461.447168:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1adfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055e1 expref: 10 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.447189:0:19501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fac200, rc 0) 00000100:00100000:2.0:1782241461.447237:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+9:15583:x1868815120070272:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 425us (620us total) trans 0 rc 301/301 00000100:00100000:2.0:1782241461.447244:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 27 00000100:00100000:1.0:1782241461.464566:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.464694:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120070400 00000100:00100000:0.0:1782241461.464705:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120070400 00000100:00100000:0.0:1782241461.464836:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:0.0:1782241461.464847:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+9:15583:x1868815120070400:12345-192.168.204.58@tcp:700:lfs.0 00000100:00100000:0.0:1782241461.464925:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+9:15583:x1868815120070400:12345-192.168.204.58@tcp:700:lfs.0 Request processed in 80us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241461.464934:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:0.0:1782241461.470832:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241461.470961:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120070656 00000100:00100000:1.0:1782241461.470973:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120070656 00000100:00100000:1.0:1782241461.471049:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 28 00000100:00100000:1.0:1782241461.471060:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+9:15583:x1868815120070656:12345-192.168.204.58@tcp:36:lfs.0 00010000:00010000:1.0:1782241461.471122:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241461.471147:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1ad28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350554e expref: 9 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.471171:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195be00) 00010000:00010000:1.0:1782241461.471177:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241461.471234:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae0f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.471248:0:17046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ad67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055be expref: 5 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.471257:0:17046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae0f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.471289:0:17046:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ad67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055be expref: 5 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.471303:0:17046:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ad67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055be expref: 5 pid: 19501 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241461.471333:0:17046:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17046:1868815140074880:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241461.471813:0:17046:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e48d87c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782241461.476269:0:17046:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c7e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17046:1868815140074880:192.168.204.58@tcp:104: 00010000:00010000:0.0:1782241461.476300:0:17046:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae0f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241461.487012:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241461.487663:0:17034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120070784 00000100:00100000:1.0:1782241461.487673:0:17034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120070784 00010000:00010000:1.0:1782241461.487717:0:17034:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ad67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055be expref: 6 pid: 19501 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241461.487803:0:17034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00100000:1.0:1782241461.487814:0:17034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2399:x1868815120070784:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241461.487830:0:17034:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241461.487838:0:17034:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ad67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055be expref: 6 pid: 19501 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.487852:0:17034:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ad67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055be expref: 6 pid: 19501 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.487874:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ad67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055be expref: 6 pid: 19501 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.487892:0:17034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195be00) 00010000:00010000:1.0:1782241461.487897:0:17034:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae0f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.487905:0:17034:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.487923:0:17034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae0f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.487959:0:17034:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241461.488021:0:17034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120070784:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 208us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241461.488038:0:17034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 15 00010000:00010000:0.0:1782241461.488802:0:17046:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.488813:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.488840:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ae16 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.488849:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ae16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.488857:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ae16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.491308:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1ae1d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.491329:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1ae1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.491339:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1ae1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782241461.491357:0:17046:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de311d2b reply state 000000007832789a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1ae1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.491370:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1ae1d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.491378:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890d4195b000) 00010000:00010000:0.0:1782241461.491381:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782241461.491385:0:17046:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782241461.491576:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782241461.491587:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.491594:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae0f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.491601:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae0f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.491607:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40030a00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241461.491611:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae0f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.491618:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae0f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.491629:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890d4195be00) 00010000:00010000:0.0:1782241461.491631:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241461.491635:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae0f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.491848:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae0f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782241461.491872:0:17046:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de311d2b reply state 000000007832789a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ae16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.491881:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ae16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.491887:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff890d4195b300) 00010000:00010000:0.0:1782241461.491888:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782241461.491897:0:17046:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1782241461.492409:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+10:15583:x1868815120070656:12345-192.168.204.58@tcp:36:lfs.0 Request processed in 21337us (21574us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1782241461.492419:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 28 00000100:00100000:1.0:1782241461.509075:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782241461.509097:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140075008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241461.509174:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241461.509272:0:18102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140075008 00000100:00100000:0.0:1782241461.509280:0:18102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140075008 00000100:00100000:0.0:1782241461.509337:0:18102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782241461.509345:0:18102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140075008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782241461.509377:0:18102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1782241461.509601:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140075008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782241461.509743:0:18102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140075008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 204us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241461.509751:0:18102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782241461.513146:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140075136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782241461.513235:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241461.513429:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140075136 00000100:00100000:0.0:1782241461.513437:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140075136 00000100:00100000:0.0:1782241461.513499:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782241461.513509:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140075136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241461.513543:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782241461.513599:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140075136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241461.513607:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782241461.513695:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140075136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241461.704632:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241461.704969:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120070912 00000100:00100000:2.0:1782241461.704979:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120070912 00000100:00100000:2.0:1782241461.705202:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00100000:2.0:1782241461.705213:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+10:15591:x1868815120070912:12345-192.168.204.58@tcp:101:lctl.0 00010000:00010000:2.0:1782241461.705317:0:19501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241461.705341:0:19501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1ae24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335055e8 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.705480:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1ae2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.705495:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1ae2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.705506:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1ae2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241461.705553:0:19501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782241461.705556:0:19501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782241461.705589:0:19501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1ae2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.705614:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac200/0xc9959f2fb1e1ae24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055e8 expref: 12 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.705633:0:19501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac800/0xc9959f2fb1e1ae2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055e8 expref: 11 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.705641:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e45e7a300) 00010000:00010000:2.0:1782241461.705644:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782241461.705647:0:19501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fac800, rc 0) 00000100:00100000:2.0:1782241461.705717:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+11:15591:x1868815120070912:12345-192.168.204.58@tcp:101:lctl.0 Request processed in 506us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241461.705724:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 29 00000100:00100000:1.0:1782241461.740925:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.743352:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120071040 00000100:00100000:0.0:1782241461.743366:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120071040 00000100:00100000:0.0:1782241461.743438:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 30 00000100:00100000:0.0:1782241461.743448:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:15592:x1868815120071040:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241461.743479:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241461.743499:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1ae32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335055ef expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.743579:0:17049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ae00/0xc9959f2fb1e1ae39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.743593:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ae00/0xc9959f2fb1e1ae39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.743606:0:17049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ae00/0xc9959f2fb1e1ae39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241461.743715:0:17049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782241461.743720:0:17049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241461.743740:0:17049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ae00/0xc9959f2fb1e1ae39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.743781:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1ae32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055ef expref: 7 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.743798:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ae00/0xc9959f2fb1e1ae39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055ef expref: 6 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.743806:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e45e7a300) 00010000:00010000:0.0:1782241461.743809:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782241461.743812:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499ae00, rc 0) 00000100:00100000:0.0:1782241461.743944:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:15592:x1868815120071040:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 496us (3026us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241461.743963:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 30 00000100:00100000:1.0:1782241461.753077:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241461.760874:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120071168 00000100:00100000:3.0:1782241461.760888:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120071168 00000100:00100000:3.0:1782241461.760971:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 31 00000100:00100000:3.0:1782241461.761079:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:15592:x1868815120071168:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241461.761213:0:17048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241461.761239:0:17048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e1ae40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335055f6 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761311:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1ae47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761326:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1ae47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761353:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1ae47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761373:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ae4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761380:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ae4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761386:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ae4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761467:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1ae55 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761488:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1ae55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761495:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1ae55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241461.761535:0:17048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782241461.761547:0:17048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782241461.761571:0:17048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1ae55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761584:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1ae47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761590:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1ae47 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761598:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1ae47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761604:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779eb800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241461.761608:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1ae47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761615:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1ae47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761627:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e45e7a300) 00010000:00010000:3.0:1782241461.761630:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241461.761635:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1ae47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761641:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eb800/0xc9959f2fb1e1ae47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761654:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ae4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761660:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ae4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761677:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ae4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761682:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e779ea600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241461.761685:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ae4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761692:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ae4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761700:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff890d4195b300) 00010000:00010000:3.0:1782241461.761703:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241461.761705:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ae4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761718:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779ea600/0xc9959f2fb1e1ae4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761745:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e779eba00/0xc9959f2fb1e1ae40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055f6 expref: 8 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761801:0:17048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1ae55 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055f6 expref: 7 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.761809:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890d4195b000) 00010000:00010000:3.0:1782241461.761811:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782241461.761814:0:17048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d200, rc 0) 00000100:00100000:3.0:1782241461.761890:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c7e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+7:15592:x1868815120071168:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 817us (8822us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241461.761906:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 31 00000100:00100000:2.0:1782241461.769724:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.771584:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120071296 00000100:00100000:0.0:1782241461.771597:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120071296 00000100:00100000:0.0:1782241461.771682:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 6 00000100:00100000:0.0:1782241461.771692:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:15592:x1868815120071296:12345-192.168.204.58@tcp:900:lfs.0 00000100:00100000:0.0:1782241461.771801:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:15592:x1868815120071296:12345-192.168.204.58@tcp:900:lfs.0 Request processed in 110us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241461.771808:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 6 00000100:00100000:1.0:1782241461.779157:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.779267:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120071552 00000100:00100000:0.0:1782241461.779276:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120071552 00000100:00100000:0.0:1782241461.779334:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 32 00000100:00100000:0.0:1782241461.779344:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:665bb25c-92e8-4fb6-a390-44e1dde8222e+7:15592:x1868815120071552:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241461.779364:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241461.779383:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1ae5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335055fd expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241461.779493:0:17049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782241461.779589:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1ae5c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055fd expref: 9 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.779603:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e45e7a300) 00010000:00010000:0.0:1782241461.779606:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782241461.779611:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1ae5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055fd expref: 9 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.779625:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499a600, rc 0) 00000100:00100000:0.0:1782241461.779686:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:665bb25c-92e8-4fb6-a390-44e1dde8222e+8:15592:x1868815120071552:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 343us (539us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1782241461.779693:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 32 00000100:00100000:2.0:1782241461.790368:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241461.790489:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120071808 00000100:00100000:1.0:1782241461.790500:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120071808 00000100:00100000:1.0:1782241461.790561:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 33 00000100:00100000:1.0:1782241461.790571:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:665bb25c-92e8-4fb6-a390-44e1dde8222e+8:15592:x1868815120071808:12345-192.168.204.58@tcp:36:lfs.0 00010000:00010000:1.0:1782241461.790628:0:19501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241461.790669:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1ae55 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335055f6 expref: 8 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.790688:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890d4195b000) 00010000:00010000:1.0:1782241461.790693:0:19501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241461.790714:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae6a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.790745:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.790800:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782241461.791010:0:19501:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000089218e56 reply state 0000000085756411 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.791024:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.791030:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890d4195b000) 00010000:00010000:1.0:1782241461.791032:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1782241461.791035:0:19501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782241461.791042:0:19501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1782241461.791227:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:665bb25c-92e8-4fb6-a390-44e1dde8222e+9:15592:x1868815120071808:12345-192.168.204.58@tcp:36:lfs.0 Request processed in 651us (865us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1782241461.791237:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 33 00000100:00100000:3.0:1782241461.804887:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.805000:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120072064 00000100:00100000:0.0:1782241461.805022:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120072064 00000100:00100000:0.0:1782241461.805079:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 2 00000100:00100000:0.0:1782241461.805089:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+9:15592:x1868815120072064:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:0.0:1782241461.805300:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+10:15592:x1868815120072064:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 212us (423us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1782241461.805309:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 2 00000100:00100000:2.0:1782241461.810118:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.810289:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120072320 00000100:00100000:0.0:1782241461.810298:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120072320 00000100:00100000:0.0:1782241461.810360:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 34 00000100:00100000:0.0:1782241461.810370:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:665bb25c-92e8-4fb6-a390-44e1dde8222e+10:15592:x1868815120072320:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241461.810393:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241461.810412:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1ae71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505604 expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810503:0:17049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1ae78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810517:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1ae78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810528:0:17049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1ae78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810539:0:17049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1ae7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810545:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1ae7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810552:0:17049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1ae7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241461.810678:0:17049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782241461.810749:0:17049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1ae78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810791:0:17049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1ae78 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810799:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1ae78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810805:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499b000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241461.810809:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1ae78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810824:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1ae78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810837:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e45e7a300) 00010000:00010000:0.0:1782241461.810840:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241461.810845:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1ae78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810851:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1ae78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810864:0:17049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1ae7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810870:0:17049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1ae7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810894:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1ae7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810900:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499a000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241461.810903:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1ae7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810909:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1ae7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.810916:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff890d4195b300) 00010000:00010000:0.0:1782241461.810918:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241461.810921:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1ae7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.811295:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1ae7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.811336:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1ae71 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505604 expref: 12 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.811346:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e45e7a300) 00010000:00010000:0.0:1782241461.811349:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782241461.811352:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1ae71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505604 expref: 12 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.811361:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499a600, rc 0) 00000100:00100000:0.0:1782241461.811463:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:665bb25c-92e8-4fb6-a390-44e1dde8222e+11:15592:x1868815120072320:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 1094us (1355us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1782241461.811490:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 34 00000100:00100000:2.0:1782241461.815406:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241461.815491:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120072448 00000100:00100000:3.0:1782241461.815501:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120072448 00000100:00100000:3.0:1782241461.815556:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 35 00000100:00100000:3.0:1782241461.815567:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+11:15592:x1868815120072448:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:3.0:1782241461.815593:0:17048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241461.815611:0:17048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e1ae8d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350560b expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.815714:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1ae94 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.815727:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1ae94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241461.815738:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1ae94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782241461.816564:0:17048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782241461.816570:0:17048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782241461.816594:0:17048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1ae94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.816629:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164ce00/0xc9959f2fb1e1ae8d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350560b expref: 13 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.816703:0:17048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1ae94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350560b expref: 12 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241461.816714:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890d4195b000) 00010000:00010000:2.0:1782241461.816717:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782241461.816720:0:17048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d600, rc 0) 00000100:00100000:2.0:1782241461.817855:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+12:15592:x1868815120072448:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 2282us (2452us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241461.817866:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 35 00000100:00100000:3.0:1782241461.834282:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.834461:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120072576 00000100:00100000:0.0:1782241461.834482:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120072576 00000100:00100000:0.0:1782241461.834536:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:0.0:1782241461.834545:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+12:15592:x1868815120072576:12345-192.168.204.58@tcp:37:lfs.0 00000100:00100000:1.0:1782241461.842153:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+12:15592:x1868815120072576:12345-192.168.204.58@tcp:37:lfs.0 Request processed in 7594us (7867us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241461.842173:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:2.0:1782241461.845691:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241461.845817:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120072832 00000100:00100000:3.0:1782241461.845828:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120072832 00000100:00100000:3.0:1782241461.845888:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 4 00000100:00100000:3.0:1782241461.845898:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7795f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+12:15592:x1868815120072832:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:3.0:1782241461.846138:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7795f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+13:15592:x1868815120072832:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 240us (454us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1782241461.846145:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 4 00000100:00100000:3.0:1782241461.921655:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241461.921797:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120072960 00000100:00100000:1.0:1782241461.921807:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120072960 00000100:00100000:1.0:1782241461.921871:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 36 00000100:00100000:1.0:1782241461.921881:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+11:15598:x1868815120072960:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:1.0:1782241461.921903:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241461.921922:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1ae9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505612 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922009:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aea2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922023:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aea2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922034:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aea2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922043:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aea9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922050:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aea9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922056:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aea9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922141:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1aeb0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922150:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1aeb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922157:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1aeb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241461.922192:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782241461.922196:0:17046:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241461.922230:0:17046:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1aeb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922252:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aea2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922258:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aea2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922264:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aea2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922270:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40031800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241461.922275:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aea2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922282:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aea2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922434:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e45e7a300) 00010000:00010000:1.0:1782241461.922438:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241461.922443:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aea2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922450:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aea2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922478:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aea9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922484:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aea9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922490:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aea9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922501:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40031e00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241461.922504:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aea9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922510:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aea9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922518:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff890d4195b300) 00010000:00010000:1.0:1782241461.922520:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241461.922523:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aea9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922529:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aea9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922559:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1ae9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505612 expref: 13 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922574:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031600/0xc9959f2fb1e1aeb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505612 expref: 12 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.922581:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890d4195b000) 00010000:00010000:1.0:1782241461.922583:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782241461.922585:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e40031600, rc 0) 00000100:00100000:1.0:1782241461.922649:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+12:15598:x1868815120072960:12345-192.168.204.58@tcp:101:bash.0 Request processed in 768us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241461.922656:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 36 00000100:00100000:2.0:1782241461.931556:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241461.931822:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120073088 00000100:00100000:3.0:1782241461.931842:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120073088 00000100:00100000:3.0:1782241461.931945:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:3.0:1782241461.931961:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:15598:x1868815120073088:12345-192.168.204.58@tcp:900:bash.0 00000100:00100000:3.0:1782241461.932079:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:15598:x1868815120073088:12345-192.168.204.58@tcp:900:bash.0 Request processed in 122us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241461.932088:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:2.0:1782241461.939534:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241461.939645:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120073344 00000100:00100000:1.0:1782241461.939668:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120073344 00000100:00100000:1.0:1782241461.939727:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 37 00000100:00100000:1.0:1782241461.939736:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+12:15598:x1868815120073344:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:1.0:1782241461.939792:0:19501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241461.939812:0:19501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1aeb7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505619 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.939929:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aebe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.939944:0:19501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1ae94 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350560b expref: 12 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.939952:0:19501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aebe lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.939985:0:19501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1ae94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350560b expref: 12 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.939999:0:19501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1ae94 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350560b expref: 12 pid: 17048 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241461.940013:0:19501:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19501:1868815140075264:192.168.204.58@tcp:104: 00000100:00100000:1.0:1782241461.940100:0:19501:0:(client.c:2701:ptlrpc_set_wait()) set ffff890d47bc2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241461.944062:0:19501:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19501:1868815140075264:192.168.204.58@tcp:104: 00010000:00010000:1.0:1782241461.944101:0:19501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aebe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241461.944837:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.944948:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120073472 00000100:00100000:0.0:1782241461.944958:0:17033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120073472 00010000:00010000:0.0:1782241461.945010:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1ae94 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350560b expref: 13 pid: 17048 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241461.945050:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 16 00000100:00100000:0.0:1782241461.945061:0:17033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+13:2399:x1868815120073472:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241461.945080:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241461.945089:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1ae94 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350560b expref: 13 pid: 17048 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.945103:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1ae94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350560b expref: 13 pid: 17048 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.945145:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1ae94 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350560b expref: 13 pid: 17048 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.945166:0:17033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890d4195b000) 00010000:00010000:0.0:1782241461.945171:0:17033:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aebe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.945197:0:17033:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aebe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.945205:0:17033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aebe lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.945244:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241461.945320:0:17033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:665bb25c-92e8-4fb6-a390-44e1dde8222e+12:2399:x1868815120073472:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 260us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241461.945329:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 16 00010000:00010000:1.0:1782241461.949053:0:19501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aebe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.949078:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aebe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.949120:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aec5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.949137:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aec5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.949149:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aec5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.949903:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e1aecc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.949917:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e1aecc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.949925:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e1aecc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241461.949939:0:19501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1782241461.949972:0:19501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aebe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.949980:0:19501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aebe lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.949987:0:19501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aebe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.950002:0:19501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40031e00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241461.950007:0:19501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aebe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.950015:0:19501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aebe lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.950031:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890d4195b000) 00010000:00010000:1.0:1782241461.950035:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241461.950041:0:19501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aebe lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.950047:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1aebe lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782241461.950066:0:19501:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e00213ff reply state 000000004d96b147 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aec5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.950078:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aec5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.950084:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff890e81803000) 00010000:00010000:1.0:1782241461.950085:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782241461.950089:0:19501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782241461.950142:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1aeb7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505619 expref: 15 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.950160:0:19501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e1aecc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505619 expref: 14 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241461.950181:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:1.0:1782241461.950183:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1782241461.950186:0:19501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e40030200, rc 0) 00000100:00100000:1.0:1782241461.950275:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+15:15598:x1868815120073344:12345-192.168.204.58@tcp:101:bash.0 Request processed in 10539us (10750us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1782241461.950288:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 37 00000100:00100000:2.0:1782241461.972899:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241461.974170:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120073600 00000100:00100000:0.0:1782241461.974182:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120073600 00000100:00100000:0.0:1782241461.974356:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 38 00000100:00100000:0.0:1782241461.974368:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+15:15598:x1868815120073600:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:0.0:1782241461.974393:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241461.974414:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1aeda lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505620 expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.974491:0:17049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aee1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.974505:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.974516:0:17049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241461.974571:0:17049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782241461.974575:0:17049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241461.974613:0:17049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.974623:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.974779:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1aeda lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505620 expref: 17 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.974799:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aee1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505620 expref: 16 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241461.974809:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:0.0:1782241461.974812:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782241461.974816:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499a000, rc 0) 00000100:00100000:0.0:1782241461.976901:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+16:15598:x1868815120073600:12345-192.168.204.58@tcp:101:bash.0 Request processed in 2267us (3753us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241461.976916:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 38 00000100:00100000:2.0:1782241461.987021:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241461.987114:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120073856 00000100:00100000:3.0:1782241461.987124:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120073856 00000100:00100000:3.0:1782241461.987212:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:3.0:1782241461.987221:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+16:15598:x1868815120073856:12345-192.168.204.58@tcp:35:bash.0 00000100:00100000:3.0:1782241461.987510:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+17:15598:x1868815120073856:12345-192.168.204.58@tcp:35:bash.0 Request processed in 289us (498us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1782241461.987517:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 5 00000100:00100000:3.0:1782241462.020985:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782241462.021006:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140075392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782241462.021069:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241462.021117:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140075392 00000100:00100000:3.0:1782241462.021124:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140075392 00000100:00100000:3.0:1782241462.021172:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782241462.021182:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140075392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782241462.021211:0:18557:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1782241462.021251:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140075392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241462.021271:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782241462.021332:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140075392:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1782241462.021494:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782241462.021691:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782241462.021701:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d45a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140075520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782241462.021738:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241462.021781:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140075520 00000100:00100000:2.0:1782241462.021785:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140075520 00000100:00100000:2.0:1782241462.021812:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782241462.021818:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140075520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782241462.021829:0:18557:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782241462.021856:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140075520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241462.021861:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1782241462.022032:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782241462.022076:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d45a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140075520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782241462.022584:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782241462.022595:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140075648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782241462.022630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241462.022785:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140075648 00000100:00100000:3.0:1782241462.022790:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140075648 00000100:00100000:3.0:1782241462.022819:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782241462.022825:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140075648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782241462.022838:0:18557:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1782241462.022871:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1868815140075648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241462.022878:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1782241462.022972:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782241462.022997:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1868815140075648:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782241462.023239:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241462.023249:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140076160:0@lo:400:kworker.0 00000100:00100000:1.0:1782241462.023283:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241462.023301:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140076672:0@lo:400:kworker.0 00000100:00100000:1.0:1782241462.023324:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241462.023343:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782241462.023348:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815140076032:0@lo:400:kworker.0 00000100:00100000:1.0:1782241462.023367:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241462.023382:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140076544:0@lo:400:kworker.0 00000100:00100000:1.0:1782241462.023402:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241462.023429:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140076672 00000100:00100000:1.0:1782241462.023433:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140076672 00000100:00100000:1.0:1782241462.023460:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140076032 00000100:00100000:1.0:1782241462.023463:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140076032 00000100:00100000:1.0:1782241462.023489:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140076544 00000100:00100000:1.0:1782241462.023492:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140076544 00000100:00100000:1.0:1782241462.023505:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782241462.023512:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140076672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241462.023549:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140076672:12345-0@lo:400:kworker.0 Request processed in 37us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241462.023566:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782241462.023580:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782241462.023586:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815140076032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241462.023614:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1868815140076032:12345-0@lo:400:kworker.0 Request processed in 28us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241462.023619:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782241462.023629:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782241462.023635:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815140076544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241462.023659:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1868815140076544:12345-0@lo:400:kworker.0 Request processed in 24us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241462.023664:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782241462.023700:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1868815140076032:0@lo:400:kworker.0 00000100:00100000:1.0:1782241462.023710:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1868815140076544:0@lo:400:kworker.0 00010000:00080000:1.0:1782241462.023721:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d47b4e300 x1868815140076672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241462.023731:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140076672:0@lo:400:kworker.0 00000100:00100000:0.0:1782241462.023960:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140075904:0@lo:400:kworker.0 00000100:00100000:0.0:1782241462.023987:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241462.024013:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140076416:0@lo:400:kworker.0 00000100:00100000:0.0:1782241462.024045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241462.024062:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815140076928:0@lo:400:kworker.0 00000100:00100000:0.0:1782241462.024080:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241462.024097:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782241462.024102:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140075776:0@lo:400:kworker.0 00000100:00100000:0.0:1782241462.024127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241462.024147:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140076288:0@lo:400:kworker.0 00000100:00100000:0.0:1782241462.024168:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241462.024182:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815140076800:0@lo:400:kworker.0 00000100:00100000:0.0:1782241462.024200:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782241462.024220:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241462.024224:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782241462.024233:0:18102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140076160 00000100:00100000:0.0:1782241462.024238:0:18102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140076160 00000100:00100000:0.0:1782241462.024261:0:18102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140075904 00000100:00100000:0.0:1782241462.024264:0:18102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140075904 00000100:00100000:0.0:1782241462.024278:0:18102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782241462.024284:0:18102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140076160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241462.024320:0:18102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140076160:12345-0@lo:400:kworker.0 Request processed in 35us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241462.024326:0:18102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782241462.024340:0:18102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782241462.024345:0:18102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140075904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241462.024374:0:18102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1868815140075904:12345-0@lo:400:kworker.0 Request processed in 29us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241462.024380:0:18102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782241462.024413:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1868815140075904:0@lo:400:kworker.0 00000100:00100000:0.0:1782241462.024430:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140076416 00000100:00100000:0.0:1782241462.024434:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140076416 00000100:00100000:0.0:1782241462.024448:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140076928 00000100:00100000:0.0:1782241462.024451:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140076928 00000100:00100000:0.0:1782241462.024481:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140076800 00000100:00100000:0.0:1782241462.024483:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140076800 00000100:00100000:0.0:1782241462.024497:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782241462.024502:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140076416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241462.024532:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1868815140076416:12345-0@lo:400:kworker.0 Request processed in 30us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241462.024539:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782241462.024550:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782241462.024556:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815140076928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241462.024579:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1868815140076928:12345-0@lo:400:kworker.0 Request processed in 24us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241462.024584:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782241462.024594:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782241462.024599:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815140076800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782241462.024624:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1868815140076800:12345-0@lo:400:kworker.0 Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241462.024630:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1782241462.024642:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782241462.024645:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782241462.024659:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1868815140076800:0@lo:400:kworker.0 00000100:00100000:0.0:1782241462.024667:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1868815140076416:0@lo:400:kworker.0 00010000:00080000:0.0:1782241462.024789:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890d4881fb80 x1868815140076928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782241462.024798:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1868815140076928:0@lo:400:kworker.0 00000100:00100000:1.0:1782241462.024949:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140075776 00000100:00100000:1.0:1782241462.024954:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140075776 00000100:00100000:1.0:1782241462.024994:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782241462.025001:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3638:x1868815140075776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241462.025039:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3638:x1868815140075776:12345-0@lo:400:kworker.0 Request processed in 39us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241462.025044:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782241462.025087:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140076160:0@lo:400:kworker.0 00000100:00100000:1.0:1782241462.025107:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3638:1868815140075776:0@lo:400:kworker.0 00000100:00100000:2.0:1782241462.025182:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140076288 00000100:00100000:2.0:1782241462.025186:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140076288 00000100:00100000:2.0:1782241462.025227:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782241462.025232:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140076288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241462.025267:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140076288:12345-0@lo:400:kworker.0 Request processed in 35us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241462.025273:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782241462.025311:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140076288:0@lo:400:kworker.0 00000100:00080000:1.0:1782241462.025363:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782241462.074372:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241462.074488:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120074112 00000100:00100000:0.0:1782241462.074498:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120074112 00000100:00100000:0.0:1782241462.074595:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 39 00000100:00100000:0.0:1782241462.074605:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+17:15608:x1868815120074112:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241462.074629:0:17048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241462.074657:0:17048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1aee8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505627 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241462.074753:0:17048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782241462.075028:0:17048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1aee8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505627 expref: 19 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.075042:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e45e7a300) 00010000:00010000:0.0:1782241462.075045:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782241462.075049:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1aee8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505627 expref: 19 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.075063:0:17048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499a600, rc 0) 00000100:00100000:0.0:1782241462.075167:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+18:15608:x1868815120074112:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 563us (808us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1782241462.075175:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 39 00000100:00100000:2.0:1782241462.077617:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241462.077919:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120074368 00000100:00100000:1.0:1782241462.077929:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120074368 00000100:00100000:1.0:1782241462.078023:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 6 00000100:00100000:1.0:1782241462.078033:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+18:15608:x1868815120074368:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:1.0:1782241462.078255:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+19:15608:x1868815120074368:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 223us (644us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1782241462.078262:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 6 00000100:00100000:2.0:1782241462.112584:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241462.112690:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120074624 00000100:00100000:0.0:1782241462.112700:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120074624 00000100:00100000:0.0:1782241462.112857:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 40 00000100:00100000:0.0:1782241462.112867:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+19:15611:x1868815120074624:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241462.112904:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241462.112924:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1aef6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350562e expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.113200:0:17049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1aefd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.113216:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1aefd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.113230:0:17049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1aefd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241462.113242:0:17049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782241462.113351:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1aef6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350562e expref: 22 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.113370:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1aefd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350562e expref: 21 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.113379:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:0.0:1782241462.113382:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782241462.113385:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499b000, rc 0) 00000100:00100000:0.0:1782241462.113436:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+21:15611:x1868815120074624:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 571us (862us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1782241462.113444:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 40 00000100:00100000:2.0:1782241462.121383:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241462.121472:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120074752 00000100:00100000:1.0:1782241462.121482:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120074752 00000100:00100000:1.0:1782241462.121573:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 41 00000100:00100000:1.0:1782241462.121583:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+21:15611:x1868815120074752:12345-192.168.204.58@tcp:54:lfs.0 00010000:00010000:1.0:1782241462.121650:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1af0b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.121667:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1af0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.121679:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1af0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.121713:0:19501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1af0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.121720:0:19501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1af0b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.121743:0:19501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1af0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.121749:0:19501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40030600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241462.121753:0:19501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1af0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.121794:0:19501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1af0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.121807:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:1.0:1782241462.121810:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782241462.121814:0:19501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1af0b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.121819:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1af0b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241462.121883:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+21:15611:x1868815120074752:12345-192.168.204.58@tcp:54:lfs.0 Request processed in 300us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241462.121964:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 41 00000100:00100000:2.0:1782241462.127026:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241462.127253:0:17034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120074880 00000100:00100000:1.0:1782241462.127263:0:17034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120074880 00000100:00100000:1.0:1782241462.127363:0:17034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:1.0:1782241462.127375:0:17034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+21:2399:x1868815120074880:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241462.127396:0:17034:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241462.127424:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1aefd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350562e expref: 21 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.127471:0:17034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:1.0:1782241462.127477:0:17034:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241462.127545:0:17034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+20:2399:x1868815120074880:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 172us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241462.127554:0:17034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:2.0:1782241462.131327:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241462.131413:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120075136 00000100:00100000:3.0:1782241462.131423:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120075136 00000100:00100000:3.0:1782241462.131489:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 7 00000100:00100000:3.0:1782241462.131499:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+20:15611:x1868815120075136:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:3.0:1782241462.131726:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+21:15611:x1868815120075136:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 228us (408us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1782241462.131735:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 7 00000040:00080000:0.0:1782241462.343691:0:17085:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1782241462.405441:0:17800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782241462.506099:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241462.506181:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120075392 00000100:00100000:1.0:1782241462.506191:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120075392 00000100:00100000:1.0:1782241462.506299:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 42 00000100:00100000:1.0:1782241462.506310:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+21:15642:x1868815120075392:12345-192.168.204.58@tcp:101:cat.0 00010000:00010000:1.0:1782241462.506338:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241462.506357:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1af12 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505635 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.506469:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af19 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.506486:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.506498:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241462.506509:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1782241462.506655:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1af12 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505635 expref: 24 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.506678:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505635 expref: 23 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.506694:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:1.0:1782241462.506697:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241462.506701:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e40031e00, rc 0) 00000100:00100000:1.0:1782241462.506905:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+23:15642:x1868815120075392:12345-192.168.204.58@tcp:101:cat.0 Request processed in 596us (815us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1782241462.506913:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 42 00000100:00100000:2.0:1782241462.527334:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241462.527387:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241462.527504:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120075776 00000100:00100000:0.0:1782241462.527514:0:17033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120075776 00000100:00100000:0.0:1782241462.527588:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 1 00000100:00100000:0.0:1782241462.527598:0:17033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+23:2396:x1868815120075776:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782241462.527614:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241462.527637:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af19 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505635 expref: 23 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.527670:0:17033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:0.0:1782241462.527675:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782241462.528137:0:17033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+22:2396:x1868815120075776:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 539us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241462.528145:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 1 00000100:00100000:3.0:1782241462.528384:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120075648 00000100:00100000:3.0:1782241462.528391:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120075648 00000100:00100000:3.0:1782241462.528427:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 8 00000100:00100000:3.0:1782241462.528434:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+22:15642:x1868815120075648:12345-192.168.204.58@tcp:35:cat.0 00000100:00100000:3.0:1782241462.528991:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+23:15642:x1868815120075648:12345-192.168.204.58@tcp:35:cat.0 Request processed in 555us (1663us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1782241462.528999:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 8 00000100:00100000:2.0:1782241462.642851:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241462.643272:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120076032 00000100:00100000:0.0:1782241462.643282:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120076032 00000100:00100000:0.0:1782241462.643348:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 43 00000100:00100000:0.0:1782241462.643359:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+23:15648:x1868815120076032:12345-192.168.204.58@tcp:101:dd.0 00010000:00010000:0.0:1782241462.643386:0:17048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241462.643409:0:17048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1af27 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350563c expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.643539:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b800/0xc9959f2fb1e1af2e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.643554:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b800/0xc9959f2fb1e1af2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.643566:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b800/0xc9959f2fb1e1af2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241462.643590:0:17048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782241462.643728:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1af27 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350563c expref: 26 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.643748:0:17048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b800/0xc9959f2fb1e1af2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350563c expref: 25 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.643811:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:0.0:1782241462.643815:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782241462.643818:0:17048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499b800, rc 0) 00000100:00100000:0.0:1782241462.643872:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+25:15648:x1868815120076032:12345-192.168.204.58@tcp:101:dd.0 Request processed in 514us (1030us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1782241462.643881:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 43 00000100:00100000:2.0:1782241462.650718:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241462.650783:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241462.651421:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120076160 00000100:00100000:0.0:1782241462.651432:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120076160 00000100:00100000:0.0:1782241462.651512:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 44 00000100:00100000:1.0:1782241462.651520:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120076288 00000100:00100000:0.0:1782241462.651523:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+25:15648:x1868815120076160:12345-192.168.204.58@tcp:101:dd.0 00000100:00100000:1.0:1782241462.651527:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120076288 00010000:00010000:0.0:1782241462.651550:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241462.651572:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1af3c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505643 expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241462.651622:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 2 00000100:00100000:1.0:1782241462.651642:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+27:2399:x1868815120076288:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241462.651657:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241462.651678:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b800/0xc9959f2fb1e1af2e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350563c expref: 27 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.651682:0:17049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b600/0xc9959f2fb1e1af43 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.651699:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b600/0xc9959f2fb1e1af43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.651729:0:17049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b600/0xc9959f2fb1e1af43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.652568:0:17032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:1.0:1782241462.652575:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241462.652648:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+26:2399:x1868815120076288:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 1017us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241462.652657:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 2 00010000:00010000:0.0:1782241462.654889:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1af3c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505643 expref: 26 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.654917:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b600/0xc9959f2fb1e1af43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505643 expref: 25 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241462.654926:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:0.0:1782241462.654929:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782241462.654932:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499b600, rc 0) 00000100:00100000:0.0:1782241462.654998:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+25:15648:x1868815120076160:12345-192.168.204.58@tcp:101:dd.0 Request processed in 3477us (4289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241462.655008:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 44 00000100:00100000:2.0:1782241462.660096:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241462.660255:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120076544 00000100:00100000:1.0:1782241462.660266:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120076544 00000100:00100000:1.0:1782241462.660330:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 45 00000100:00100000:1.0:1782241462.660341:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+25:15648:x1868815120076544:12345-192.168.204.58@tcp:36:dd.0 00010000:00010000:1.0:1782241462.660396:0:19501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241462.660422:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aee1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505620 expref: 25 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.660464:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:1.0:1782241462.660469:0:19501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241462.660645:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af4a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.660659:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.660669:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782241462.662186:0:19501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1782241462.662239:0:19501:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000099ec5f24 reply state 000000006f996679 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.662258:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241462.662265:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:1.0:1782241462.662268:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782241462.662271:0:19501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782241462.662382:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+27:15648:x1868815120076544:12345-192.168.204.58@tcp:36:dd.0 Request processed in 2040us (2291us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1782241462.662391:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 45 00000020:00080000:1.0:1782241462.662396:0:19501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782241462.835232:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241462.835329:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120076800 00000100:00100000:3.0:1782241462.835338:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120076800 00000100:00100000:3.0:1782241462.835414:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 9 00000100:00100000:3.0:1782241462.835424:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+27:15648:x1868815120076800:12345-192.168.204.58@tcp:35:dd.0 00000100:00100000:3.0:1782241462.835718:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+28:15648:x1868815120076800:12345-192.168.204.58@tcp:35:dd.0 Request processed in 294us (494us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1782241462.835725:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 9 00010000:00010000:3.0:1782241463.045126:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241463.105632:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241463.106470:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120076928 00000100:00100000:1.0:1782241463.106485:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120076928 00000100:00100000:1.0:1782241463.106580:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 46 00000100:00100000:1.0:1782241463.106592:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+28:15662:x1868815120076928:12345-192.168.204.58@tcp:101:stat.0 00010000:00010000:1.0:1782241463.106632:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241463.106655:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1af51 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350564a expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.106738:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af58 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.106752:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af58 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.106790:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af58 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.106804:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310a00/0xc9959f2fb1e1af5f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.106811:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310a00/0xc9959f2fb1e1af5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.106817:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310a00/0xc9959f2fb1e1af5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.106888:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311200/0xc9959f2fb1e1af66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.106898:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311200/0xc9959f2fb1e1af66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.106904:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311200/0xc9959f2fb1e1af66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241463.106950:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1782241463.106965:0:17046:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241463.107003:0:17046:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311200/0xc9959f2fb1e1af66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107016:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311200/0xc9959f2fb1e1af66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107038:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af58 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107043:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af58 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107050:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af58 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107054:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c310200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241463.107057:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af58 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107064:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af58 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107075:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890d4195b000) 00010000:00010000:1.0:1782241463.107078:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241463.107082:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af58 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782241463.107200:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782241463.107588:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af58 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107607:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310a00/0xc9959f2fb1e1af5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107624:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310a00/0xc9959f2fb1e1af5f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107630:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310a00/0xc9959f2fb1e1af5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107635:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c310a00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241463.107638:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310a00/0xc9959f2fb1e1af5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107644:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310a00/0xc9959f2fb1e1af5f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107654:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff890e81803000) 00010000:00010000:1.0:1782241463.107656:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241463.107659:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310a00/0xc9959f2fb1e1af5f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107665:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310a00/0xc9959f2fb1e1af5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107698:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030600/0xc9959f2fb1e1af51 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350564a expref: 30 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107713:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311200/0xc9959f2fb1e1af66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350564a expref: 29 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.107720:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:1.0:1782241463.107723:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241463.107731:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c311200, rc 0) 00000100:00100000:1.0:1782241463.107908:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+29:15662:x1868815120076928:12345-192.168.204.58@tcp:101:stat.0 Request processed in 1319us (2283us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241463.107918:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 46 00000100:00100000:2.0:1782241463.228888:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241463.229899:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120077184 00000100:00100000:0.0:1782241463.229911:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120077184 00000100:00100000:0.0:1782241463.229977:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 47 00000100:00100000:0.0:1782241463.229988:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+29:15668:x1868815120077184:12345-192.168.204.58@tcp:36:truncate.0 00010000:00010000:0.0:1782241463.230047:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241463.230076:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311200/0xc9959f2fb1e1af66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350564a expref: 29 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.230098:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:0.0:1782241463.230103:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782241463.230302:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1af6d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.230317:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1af6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.230342:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1af6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782241463.230387:0:17048:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:0.0:1782241463.230415:0:17048:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004196c5b6 reply state 00000000d5096e57 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1af6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.230428:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1af6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.230435:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:0.0:1782241463.230439:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782241463.230453:0:17048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782241463.230602:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+31:15668:x1868815120077184:12345-192.168.204.58@tcp:36:truncate.0 Request processed in 614us (1722us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1782241463.230612:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 47 00000020:00080000:0.0:1782241463.230618:0:17048:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1782241463.520950:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241463.521083:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120077312 00000100:00100000:1.0:1782241463.521096:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120077312 00000100:00100000:1.0:1782241463.521189:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 48 00000100:00100000:1.0:1782241463.521214:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+31:15682:x1868815120077312:12345-192.168.204.58@tcp:101:stat.0 00010000:00010000:1.0:1782241463.521249:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241463.521276:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310a00/0xc9959f2fb1e1af74 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505651 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521374:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af7b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521394:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521408:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521422:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1af82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521430:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1af82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521455:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1af82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521556:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310600/0xc9959f2fb1e1af89 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521584:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310600/0xc9959f2fb1e1af89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521592:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310600/0xc9959f2fb1e1af89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241463.521648:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1782241463.521654:0:17046:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241463.521676:0:17046:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310600/0xc9959f2fb1e1af89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521690:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310600/0xc9959f2fb1e1af89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521700:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521707:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af7b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521713:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af7b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521719:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c310200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241463.521725:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af7b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521732:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af7b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521747:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890d4195b000) 00010000:00010000:1.0:1782241463.521820:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241463.521828:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af7b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521836:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1af7b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521855:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1af82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521861:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1af82 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521866:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1af82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521872:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311e00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241463.521875:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1af82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521881:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1af82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521889:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff890e81803000) 00010000:00010000:1.0:1782241463.521892:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241463.521895:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1af82 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521901:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1af82 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521935:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310a00/0xc9959f2fb1e1af74 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505651 expref: 33 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521964:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310600/0xc9959f2fb1e1af89 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505651 expref: 32 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.521972:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:1.0:1782241463.521974:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782241463.521977:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c310600, rc 0) 00000100:00100000:1.0:1782241463.522101:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+32:15682:x1868815120077312:12345-192.168.204.58@tcp:101:stat.0 Request processed in 889us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241463.522109:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 48 00000100:00100000:2.0:1782241463.656363:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241463.656484:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120077568 00000100:00100000:0.0:1782241463.656495:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120077568 00000100:00100000:0.0:1782241463.656551:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 49 00000100:00100000:0.0:1782241463.656560:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+32:15692:x1868815120077568:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241463.656578:0:17048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241463.656595:0:17048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1af90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505658 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241463.656707:0:17048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782241463.656816:0:17048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1af90 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505658 expref: 34 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.656830:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e45e7a300) 00010000:00010000:0.0:1782241463.656834:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782241463.656839:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1af90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505658 expref: 34 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.656853:0:17048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499a000, rc 0) 00000100:00100000:0.0:1782241463.657002:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+33:15692:x1868815120077568:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 441us (648us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1782241463.657010:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 49 00000100:00100000:3.0:1782241463.660293:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241463.660584:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120077824 00000100:00100000:1.0:1782241463.660594:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120077824 00000100:00100000:1.0:1782241463.660689:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00100000:1.0:1782241463.660700:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7795c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+33:15692:x1868815120077824:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:1.0:1782241463.660957:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7795c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+34:15692:x1868815120077824:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 258us (672us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1782241463.660965:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 10 00000100:00100000:2.0:1782241463.739008:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241463.739513:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120078080 00000100:00100000:1.0:1782241463.739523:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120078080 00000100:00100000:1.0:1782241463.739620:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 50 00000100:00100000:1.0:1782241463.739631:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+34:15698:x1868815120078080:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:1.0:1782241463.739664:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241463.739685:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310a00/0xc9959f2fb1e1af9e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350565f expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.740212:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.740228:0:17046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e1aecc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505619 expref: 35 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.740236:0:17046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310600/0xc9959f2fb1e1af89 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505651 expref: 35 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.740244:0:17046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.740274:0:17046:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310600/0xc9959f2fb1e1af89 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505651 expref: 35 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.740305:0:17046:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310600/0xc9959f2fb1e1af89 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505651 expref: 35 pid: 17046 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241463.740318:0:17046:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17046:1868815140077056:192.168.204.58@tcp:104: 00010000:00010000:0.0:1782241463.740419:0:17046:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e1aecc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505619 expref: 35 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.740429:0:17046:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e1aecc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505619 expref: 35 pid: 19501 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241463.740448:0:17046:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17046:1868815140077184:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241463.740471:0:17046:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e487cfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241463.748551:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241463.748577:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241463.748603:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120078208 00000100:00100000:3.0:1782241463.748615:0:17033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120078208 00010000:00010000:3.0:1782241463.748659:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310600/0xc9959f2fb1e1af89 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505651 expref: 36 pid: 17046 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241463.748683:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120078336 00000100:00100000:3.0:1782241463.748686:0:17033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120078336 00010000:00010000:3.0:1782241463.748695:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e1aecc lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505619 expref: 37 pid: 19501 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241463.748710:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:3.0:1782241463.748718:0:17033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d41937c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+37:2399:x1868815120078208:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241463.748730:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241463.748736:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310600/0xc9959f2fb1e1af89 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505651 expref: 37 pid: 17046 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241463.748747:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310600/0xc9959f2fb1e1af89 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505651 expref: 37 pid: 17046 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241463.748821:0:17033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:3.0:1782241463.748826:0:17033:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241463.748836:0:17033:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241463.748843:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241463.748897:0:17033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d41937c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+37:2399:x1868815120078208:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 178us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241463.748905:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 17 00000100:00100000:3.0:1782241463.748952:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 18 00000100:00100000:3.0:1782241463.748959:0:17033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+36:2399:x1868815120078336:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241463.748966:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241463.748971:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e1aecc lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505619 expref: 36 pid: 19501 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241463.748981:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e1aecc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505619 expref: 36 pid: 19501 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241463.748991:0:17033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:3.0:1782241463.748994:0:17033:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241463.749001:0:17033:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241463.749018:0:17033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241463.749033:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241463.749048:0:17033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+36:2399:x1868815120078336:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 90us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241463.749054:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 18 00010000:00010000:3.0:1782241463.749217:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310600/0xc9959f2fb1e1af89 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505651 expref: 35 pid: 17046 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241463.749234:0:17046:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17046:1868815140077056:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241463.749244:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030200/0xc9959f2fb1e1aecc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505619 expref: 34 pid: 19501 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241463.749255:0:17046:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17046:1868815140077184:192.168.204.58@tcp:104: 00010000:00010000:3.0:1782241463.749273:0:17046:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241463.749282:0:17046:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241463.749288:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782241463.749304:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1782241463.749418:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310a00/0xc9959f2fb1e1af9e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350565f expref: 35 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241463.749454:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350565f expref: 34 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241463.749461:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:3.0:1782241463.749464:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782241463.749466:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499a000, rc 0) 00000100:00100000:3.0:1782241463.749505:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+34:15698:x1868815120078080:12345-192.168.204.58@tcp:101:bash.0 Request processed in 9877us (10506us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1782241463.749513:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 50 00000100:00100000:0.0:1782241463.753787:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241463.755010:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120078592 00000100:00100000:1.0:1782241463.755039:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120078592 00000100:00100000:1.0:1782241463.755089:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 51 00000100:00100000:1.0:1782241463.755100:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+34:15698:x1868815120078592:12345-192.168.204.58@tcp:36:bash.0 00010000:00010000:1.0:1782241463.756104:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1afb3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.756122:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1afb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.756133:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1afb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782241463.756556:0:19501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:1.0:1782241463.756582:0:19501:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003919785c reply state 0000000066982d49 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1afb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.756595:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1afb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.756602:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:1.0:1782241463.756606:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782241463.756609:0:19501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782241463.756721:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+37:15698:x1868815120078592:12345-192.168.204.58@tcp:36:bash.0 Request processed in 1621us (2974us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1782241463.756730:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 51 00000020:00080000:1.0:1782241463.756735:0:19501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782241463.763943:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241463.764034:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120078720 00000100:00100000:0.0:1782241463.764043:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120078720 00000100:00100000:0.0:1782241463.764093:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 52 00000100:00100000:0.0:1782241463.764101:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+37:15698:x1868815120078720:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:0.0:1782241463.764121:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241463.764143:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1afba lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505666 expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.764192:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1afba lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505666 expref: 38 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.764411:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1afba lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505666 expref: 38 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.764451:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:0.0:1782241463.764454:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782241463.764457:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499b000, rc 0) 00000100:00100000:0.0:1782241463.764539:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+38:15698:x1868815120078720:12345-192.168.204.58@tcp:101:bash.0 Request processed in 438us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241463.764546:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 52 00000100:00100000:2.0:1782241463.770542:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241463.772488:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120078848 00000100:00100000:0.0:1782241463.772501:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120078848 00000100:00100000:0.0:1782241463.772575:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 53 00000100:00100000:0.0:1782241463.772830:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+38:15698:x1868815120078848:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:0.0:1782241463.772851:0:17048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241463.772873:0:17048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1afc1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350566d expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.772961:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b400/0xc9959f2fb1e1afc8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.772977:0:17048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350565f expref: 39 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.772987:0:17048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b400/0xc9959f2fb1e1afc8 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.773022:0:17048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350565f expref: 39 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.773036:0:17048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350565f expref: 39 pid: 17046 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241463.773065:0:17048:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17048:1868815140077312:192.168.204.58@tcp:104: 00000100:00100000:0.0:1782241463.773222:0:17048:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e487cfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782241463.779611:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241463.779792:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120078976 00000100:00100000:1.0:1782241463.779802:0:17033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120078976 00010000:00010000:1.0:1782241463.779846:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350565f expref: 40 pid: 17046 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241463.779943:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 19 00000100:00100000:1.0:1782241463.779954:0:17033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+40:2398:x1868815120078976:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241463.779969:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241463.779978:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350565f expref: 40 pid: 17046 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.779991:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350565f expref: 40 pid: 17046 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.780016:0:17033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:1.0:1782241463.780021:0:17033:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b400/0xc9959f2fb1e1afc8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.780044:0:17033:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b400/0xc9959f2fb1e1afc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.780053:0:17033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b400/0xc9959f2fb1e1afc8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.780074:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241463.780130:0:17033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+40:2398:x1868815120078976:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 177us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241463.780138:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 19 00010000:00010000:0.0:1782241463.780249:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1afa5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350565f expref: 39 pid: 17046 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241463.780266:0:17048:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17048:1868815140077312:192.168.204.58@tcp:104: 00010000:00010000:0.0:1782241463.780285:0:17048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b400/0xc9959f2fb1e1afc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.780295:0:17048:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b400/0xc9959f2fb1e1afc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.780301:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b400/0xc9959f2fb1e1afc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241463.780493:0:17048:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782241463.780498:0:17048:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241463.780521:0:17048:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b400/0xc9959f2fb1e1afc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.780552:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1afc1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350566d expref: 39 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.780569:0:17048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b400/0xc9959f2fb1e1afc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350566d expref: 38 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241463.780577:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:0.0:1782241463.780587:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782241463.780591:0:17048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499b400, rc 0) 00000100:00100000:0.0:1782241463.780617:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+38:15698:x1868815120078848:12345-192.168.204.58@tcp:101:bash.0 Request processed in 8034us (10082us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241463.780623:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 53 00000100:00100000:2.0:1782241463.787206:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241463.787285:0:20076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120079232 00000100:00100000:1.0:1782241463.787295:0:20076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120079232 00000100:00100000:1.0:1782241463.787365:0:20076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:1.0:1782241463.787376:0:20076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+38:15698:x1868815120079232:12345-192.168.204.58@tcp:103:bash.0 00010000:00010000:1.0:1782241463.787403:0:20076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782241463.787438:0:20076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b000/0xc9959f2fb1e1afba lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505666 expref: 38 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.787462:0:20076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b400/0xc9959f2fb1e1afc8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350566d expref: 37 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.787472:0:20076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:1.0:1782241463.787478:0:20076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241463.787548:0:20076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+36:15698:x1868815120079232:12345-192.168.204.58@tcp:103:bash.0 Request processed in 172us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241463.787556:0:20076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 3 00000100:00100000:2.0:1782241463.791166:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241463.791250:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120079360 00000100:00100000:3.0:1782241463.791259:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120079360 00000100:00100000:3.0:1782241463.791319:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 54 00000100:00100000:3.0:1782241463.791330:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+36:15698:x1868815120079360:12345-192.168.204.58@tcp:58:bash.0 00010000:00010000:3.0:1782241463.791462:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1afcf lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241463.791480:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1afcf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241463.791490:0:17046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1afcf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782241463.792962:0:17046:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782241463.793442:0:17046:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1782241463.793569:0:17046:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1782241463.793875:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+36:15698:x1868815120079360:12345-192.168.204.58@tcp:58:bash.0 Request processed in 2540us (2722us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241463.793886:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 54 00000100:00100000:3.0:1782241463.803082:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241463.808580:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120079488 00000100:00100000:1.0:1782241463.808596:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120079488 00000100:00100000:1.0:1782241463.808675:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 55 00000100:00100000:1.0:1782241463.808685:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+36:15698:x1868815120079488:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:1.0:1782241463.808704:0:19501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782241463.808725:0:19501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1afd6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505674 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.808800:0:19501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1afcf lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.808812:0:19501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1afd6 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505674 expref: 37 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.808832:0:19501:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1afcf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.808869:0:19501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1afd6 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505674 expref: 37 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.808885:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:1.0:1782241463.808888:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782241463.808893:0:19501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1afd6 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505674 expref: 37 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241463.808901:0:19501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e7c310200, rc 0) 00000100:00100000:1.0:1782241463.808960:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+37:15698:x1868815120079488:12345-192.168.204.58@tcp:101:bash.0 Request processed in 276us (5888us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241463.808968:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 55 00010000:00010000:1.0:1782241464.069945:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782241464.390180:0:17085:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1782241464.390191:0:17085:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782241464.390221:0:17085:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1782241464.390230:0:17085:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1782241464.390373:0:17085:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17085:1868815140077440:192.168.204.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782241464.392378:0:17085:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67ffff00 going to sleep for 11 seconds 00000100:00100000:0.0:1782241464.400077:0:17085:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17085:1868815140077440:192.168.204.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782241464.404069:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241464.404619:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120079616 00000100:00100000:0.0:1782241464.404629:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120079616 00000100:00100000:0.0:1782241464.404693:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 56 00000100:00100000:0.0:1782241464.404704:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+37:15699:x1868815120079616:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782241464.404736:0:17049:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782241464.404890:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+37:15699:x1868815120079616:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 Request processed in 188us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241464.404899:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 56 00000100:00100000:3.0:1782241464.416889:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241464.417005:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120079744 00000100:00100000:1.0:1782241464.417016:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120079744 00000100:00100000:1.0:1782241464.417071:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 57 00000100:00100000:1.0:1782241464.417081:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+37:15699:x1868815120079744:12345-192.168.204.58@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782241464.417156:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311c00/0xc9959f2fb1e1afdd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417175:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311c00/0xc9959f2fb1e1afdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417188:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311c00/0xc9959f2fb1e1afdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417253:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1afe4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417276:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1afe4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417284:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1afe4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417307:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311400/0xc9959f2fb1e1afeb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417316:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311400/0xc9959f2fb1e1afeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417324:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311400/0xc9959f2fb1e1afeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782241464.417371:0:19501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1782241464.417376:0:19501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782241464.417389:0:19501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311400/0xc9959f2fb1e1afeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417401:0:19501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311c00/0xc9959f2fb1e1afdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417408:0:19501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311c00/0xc9959f2fb1e1afdd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417415:0:19501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311c00/0xc9959f2fb1e1afdd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417432:0:19501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311c00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241464.417436:0:19501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311c00/0xc9959f2fb1e1afdd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417451:0:19501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311c00/0xc9959f2fb1e1afdd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417464:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890d4195bf00) 00010000:00010000:1.0:1782241464.417467:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241464.417472:0:19501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311c00/0xc9959f2fb1e1afdd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417478:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311c00/0xc9959f2fb1e1afdd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417493:0:19501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1afe4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417498:0:19501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1afe4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417504:0:19501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1afe4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417509:0:19501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311a00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241464.417512:0:19501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1afe4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417519:0:19501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1afe4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417526:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff890e81803a00) 00010000:00010000:1.0:1782241464.417529:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241464.417532:0:19501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1afe4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417550:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1afe4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417566:0:19501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311400/0xc9959f2fb1e1afeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417572:0:19501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311400/0xc9959f2fb1e1afeb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417578:0:19501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311400/0xc9959f2fb1e1afeb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417583:0:19501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:1.0:1782241464.417586:0:19501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311400/0xc9959f2fb1e1afeb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417592:0:19501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311400/0xc9959f2fb1e1afeb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417600:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:1.0:1782241464.417603:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782241464.417606:0:19501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311400/0xc9959f2fb1e1afeb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.417612:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311400/0xc9959f2fb1e1afeb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241464.417687:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+37:15699:x1868815120079744:12345-192.168.204.58@tcp:34:lhsmtool_posix.0 Request processed in 606us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241464.417695:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 57 00000100:00100000:2.0:1782241464.431716:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241464.431879:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120080000 00000100:00100000:0.0:1782241464.431900:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120080000 00000100:00100000:0.0:1782241464.431961:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 58 00000100:00100000:0.0:1782241464.431972:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+37:15699:x1868815120080000:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782241464.432004:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241464.432024:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1aff2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350567b expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.432144:0:17049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aff9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.432161:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aff9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.432173:0:17049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aff9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241464.432187:0:17049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782241464.432280:0:17049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aff9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.432288:0:17049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aff9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.432294:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aff9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.432300:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499a000 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241464.432304:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aff9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.432312:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aff9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.432332:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:0.0:1782241464.432335:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782241464.432340:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aff9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.432347:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1aff9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.432389:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1aff2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350567b expref: 39 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.432400:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff890d4195bf00) 00010000:00010000:0.0:1782241464.432402:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782241464.432406:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1aff2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350567b expref: 39 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.432426:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499b200, rc 0) 00000100:00100000:0.0:1782241464.432505:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+38:15699:x1868815120080000:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 535us (799us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1782241464.432514:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 58 00000100:00100000:2.0:1782241464.439963:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241464.440153:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120080128 00000100:00100000:1.0:1782241464.440163:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120080128 00000100:00100000:1.0:1782241464.440227:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 59 00000100:00100000:1.0:1782241464.440237:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+38:15699:x1868815120080128:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782241464.440274:0:19501:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782241464.445917:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+38:15699:x1868815120080128:12345-192.168.204.58@tcp:53:lhsmtool_posix.0 Request processed in 5667us (5950us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241464.445934:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 59 00000100:00100000:1.0:1782241464.449576:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241464.449683:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120080384 00000100:00100000:0.0:1782241464.449693:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120080384 00000100:00100000:0.0:1782241464.449754:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 60 00000100:00100000:0.0:1782241464.449801:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+38:15699:x1868815120080384:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782241464.449826:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241464.449847:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b007 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505682 expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782241464.450292:0:17049:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:0.0:1782241464.450299:0:17049:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1782241464.450321:0:17049:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1782241464.450594:0:17049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1b00e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.450608:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1b00e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.450620:0:17049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1b00e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.450677:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b007 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505682 expref: 41 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.450696:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1b00e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505682 expref: 40 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.450706:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890d4195be00) 00010000:00010000:0.0:1782241464.450708:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782241464.450712:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499a000, rc 0) 00000100:00100000:0.0:1782241464.450814:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+40:15699:x1868815120080384:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 1015us (1249us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1782241464.450822:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 60 00000100:00100000:2.0:1782241464.455683:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241464.455814:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120080640 00000100:00100000:0.0:1782241464.455825:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120080640 00000100:00100000:0.0:1782241464.455900:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 61 00000100:00100000:0.0:1782241464.455913:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+40:15699:x1868815120080640:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782241464.456007:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782241464.456038:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1b00e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505682 expref: 40 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456057:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890d4195be00) 00010000:00010000:0.0:1782241464.456069:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782241464.456093:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b01c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456107:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b01c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456117:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b01c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456131:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a800/0xc9959f2fb1e1b023 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcca9b1c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456138:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a800/0xc9959f2fb1e1b023 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcca9b1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456145:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a800/0xc9959f2fb1e1b023 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcca9b1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456199:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b01c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456207:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b01c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456214:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b01c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456227:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499b200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241464.456232:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b01c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456240:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b01c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456249:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890d4195b000) 00010000:00010000:0.0:1782241464.456252:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241464.456256:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b01c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456262:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b01c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456271:0:17048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a800/0xc9959f2fb1e1b023 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcca9b1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456276:0:17048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a800/0xc9959f2fb1e1b023 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcca9b1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456282:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a800/0xc9959f2fb1e1b023 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcca9b1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456287:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499a800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:0.0:1782241464.456290:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a800/0xc9959f2fb1e1b023 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcca9b1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456297:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a800/0xc9959f2fb1e1b023 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcca9b1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456318:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xcca9b1c8 (ffff890d4195bd00) 00010000:00010000:0.0:1782241464.456320:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782241464.456324:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a800/0xc9959f2fb1e1b023 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcca9b1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.456330:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a800/0xc9959f2fb1e1b023 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcca9b1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241464.456441:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+39:15699:x1868815120080640:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 529us (768us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782241464.456450:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 61 00000100:00100000:2.0:1782241464.462674:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241464.462787:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120080768 00000100:00100000:0.0:1782241464.462797:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120080768 00000100:00100000:0.0:1782241464.462903:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 62 00000100:00100000:0.0:1782241464.462914:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+39:15699:x1868815120080768:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782241464.462936:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241464.462959:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a800/0xc9959f2fb1e1b02a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505689 expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.463007:0:17049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b031 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.463020:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b031 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.463031:0:17049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b031 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.463149:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a800/0xc9959f2fb1e1b02a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505689 expref: 41 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.463177:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b200/0xc9959f2fb1e1b031 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505689 expref: 40 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.463186:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890d4195bd00) 00010000:00010000:0.0:1782241464.463189:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782241464.463193:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499b200, rc 0) 00000100:00100000:0.0:1782241464.463258:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+40:15699:x1868815120080768:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 346us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241464.463267:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 62 00000100:00100000:3.0:1782241464.472172:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241464.474354:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120081024 00000100:00100000:0.0:1782241464.474369:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120081024 00000100:00100000:1.0:1782241464.475705:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 63 00000100:00100000:1.0:1782241464.475718:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+40:15699:x1868815120081024:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782241464.476704:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1b038 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.476723:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1b038 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.476735:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1b038 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782241464.478682:0:17048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1782241464.478701:0:17048:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 527736943993ns, next at 528736940503ns, rc = 0 00000004:00010000:1.0:1782241464.478799:0:17048:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021dd8827 reply state 00000000635eddf3 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1b038 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.479002:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1b038 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.479012:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890d4195bd00) 00010000:00010000:1.0:1782241464.479030:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1782241464.479034:0:17048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782241464.481406:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+42:15699:x1868815120081024:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 5677us (9232us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1782241464.481429:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 63 00000100:00100000:2.0:1782241464.487978:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241464.488063:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120081152 00000100:00100000:3.0:1782241464.488086:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120081152 00000100:00100000:3.0:1782241464.488194:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 64 00000100:00100000:3.0:1782241464.488205:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+42:15699:x1868815120081152:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782241464.488231:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241464.488262:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1b03f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505690 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.488320:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1b03f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505690 expref: 43 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.488335:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1b03f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505690 expref: 43 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.488353:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890d4195bd00) 00010000:00010000:3.0:1782241464.488356:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782241464.488359:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164d600, rc 0) 00000100:00100000:3.0:1782241464.488442:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+43:15699:x1868815120081152:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 238us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241464.488449:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 64 00000100:00100000:2.0:1782241464.497856:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241464.497947:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120081280 00000100:00100000:0.0:1782241464.497959:0:19173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120081280 00000100:00100000:0.0:1782241464.498028:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:0.0:1782241464.498038:0:19173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e77fcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2398:x1868815120081280:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782241464.498292:0:19173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e77fcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:2398:x1868815120081280:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 Request processed in 253us (444us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1782241464.498300:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00080000:1.0:1782241464.498779:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241464.501867:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241464.502524:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120081536 00000100:00100000:0.0:1782241464.502535:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120081536 00000100:00100000:0.0:1782241464.502654:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:0.0:1782241464.502666:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+43:15699:x1868815120081536:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782241464.502963:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+44:15699:x1868815120081536:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 298us (1105us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1782241464.502982:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 11 00000100:00100000:3.0:1782241464.510807:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241464.510926:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120081792 00000100:00100000:2.0:1782241464.510936:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120081792 00000100:00100000:2.0:1782241464.511005:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 65 00000100:00100000:2.0:1782241464.511015:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+44:15699:x1868815120081792:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782241464.511139:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+44:15699:x1868815120081792:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 126us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241464.511146:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 65 00000100:00100000:2.0:1782241464.514065:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241464.514325:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120081920 00000100:00100000:0.0:1782241464.514336:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120081920 00000100:00100000:0.0:1782241464.514397:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 66 00000100:00100000:0.0:1782241464.514408:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+44:15699:x1868815120081920:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782241464.514439:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241464.514461:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a800/0xc9959f2fb1e1b046 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d333505697 expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.514531:0:17049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1b04d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.514546:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1b04d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.514557:0:17049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1b04d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241464.514708:0:17049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782241464.514729:0:17049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1b04d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.514959:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a800/0xc9959f2fb1e1b046 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505697 expref: 46 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.514984:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1b04d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505697 expref: 45 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.515167:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890d4195bd00) 00010000:00010000:0.0:1782241464.515180:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782241464.515184:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499a000, rc 0) 00000100:00100000:2.0:1782241464.523641:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+45:15699:x1868815120081920:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 9219us (9570us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241464.523655:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 66 00000100:00100000:3.0:1782241464.526879:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241464.527034:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120082048 00000100:00100000:0.0:1782241464.527044:0:18556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120082048 00000100:00100000:0.0:1782241464.527109:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:0.0:1782241464.527120:0:18556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:2399:x1868815120082048:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782241464.527138:0:18556:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241464.527159:0:18556:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b054 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d33350569e expref: -99 pid: 18556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782241464.527184:0:18556:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3ad8b8, blocks: 0x0 00010000:00010000:0.0:1782241464.527204:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1782241464.527209:0:18556:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782241464.527218:0:18556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b054 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350569e expref: 7 pid: 18556 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.527236:0:18556:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b054 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350569e expref: 7 pid: 18556 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.527250:0:18556:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499be00, rc 0) 00000100:00100000:0.0:1782241464.527313:0:18556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:2399:x1868815120082048:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 194us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241464.527320:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:3.0:1782241464.533366:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241464.533502:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120082304 00000100:00100000:2.0:1782241464.533512:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120082304 00000100:00100000:2.0:1782241464.533578:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 67 00000100:00100000:2.0:1782241464.533589:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+45:15699:x1868815120082304:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782241464.533699:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+45:15699:x1868815120082304:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 111us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241464.533707:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 67 00000100:00100000:3.0:1782241464.538336:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241464.538574:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120082432 00000100:00100000:0.0:1782241464.538584:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120082432 00000100:00100000:0.0:1782241464.538657:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 68 00000100:00100000:0.0:1782241464.538667:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+45:15699:x1868815120082432:12345-192.168.204.58@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1782241464.548644:0:17027:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:1.0:1782241464.548661:0:17027:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1782241464.548727:0:17027:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:2.0:1782241464.548838:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.548851:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae6a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.548858:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.548863:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40030a00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241464.548868:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.548875:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae6a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.548891:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890d4195b000) 00010000:00010000:2.0:1782241464.548893:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1782241464.548895:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1782241464.548898:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae6a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241464.548912:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140077568:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1782241464.548914:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40030a00/0xc9959f2fb1e1ae6a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782241464.548975:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241464.549035:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140077568 00000100:00100000:0.0:1782241464.549042:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140077568 00000100:00100000:2.0:1782241464.549056:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+20:15699:x1868815120082432:12345-192.168.204.58@tcp:44:lhsmtool_posix.0 Request processed in 10389us (10729us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241464.549067:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 68 00000100:00100000:0.0:1782241464.549085:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782241464.549093:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140077568:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1782241464.549094:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782241464.549405:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ae16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549413:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ae16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782241464.549430:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782241464.549433:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1782241464.549436:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782241464.549438:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1782241464 -> 1782241464 00010000:00010000:3.0:1782241464.549440:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ae16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782241464.549440:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1782241464.549445:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499ac00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241464.549449:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ae16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549455:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ae16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549464:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff890d4195b300) 00010000:00010000:3.0:1782241464.549467:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241464.549470:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ae16 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549476:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ac00/0xc9959f2fb1e1ae16 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241464.549487:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1868815140077568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 395us (512us total) trans 8589934596 rc 0/0 00010000:00010000:3.0:1782241464.549492:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1ae1d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241464.549494:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1782241464.549499:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1ae1d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549504:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1ae1d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549509:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499ba00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241464.549513:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1ae1d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549528:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1ae1d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549536:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890d4195b000) 00010000:00010000:3.0:1782241464.549538:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241464.549541:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1ae1d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549546:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499ba00/0xc9959f2fb1e1ae1d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549558:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aec5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549564:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aec5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549569:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aec5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549573:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40031800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241464.549576:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aec5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549581:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aec5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549587:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff890e81803000) 00010000:00010000:3.0:1782241464.549589:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241464.549592:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aec5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549602:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031800/0xc9959f2fb1e1aec5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549619:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549625:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af4a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549631:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549635:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e40031e00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241464.549638:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549643:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af4a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549651:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:3.0:1782241464.549653:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241464.549656:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af4a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549662:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e40031e00/0xc9959f2fb1e1af4a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549672:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1af6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549679:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1af6d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549697:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1af6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549702:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499a600 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241464.549716:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1af6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549825:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1af6d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549839:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:3.0:1782241464.549842:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241464.549844:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1af6d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549850:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a600/0xc9959f2fb1e1af6d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549862:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1afb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549868:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1afb3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549874:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1afb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549879:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311e00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241464.549882:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1afb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549898:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1afb3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549908:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:3.0:1782241464.549910:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241464.549913:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1afb3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549919:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311e00/0xc9959f2fb1e1afb3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549931:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1b038 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549937:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1b038 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549943:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1b038 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549947:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e7c311a00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241464.549950:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1b038 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549956:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1b038 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549963:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890d4195bd00) 00010000:00010000:3.0:1782241464.549965:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782241464.549968:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1b038 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.549983:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c311a00/0xc9959f2fb1e1b038 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782241464.550969:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff890d4793f100/2, rc 0, transno 8589934596 00000100:00100000:0.0:1782241464.550980:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140077568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782241464.552443:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241464.552706:0:19502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120082560 00000100:00100000:2.0:1782241464.552715:0:19502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120082560 00000100:00100000:2.0:1782241464.552797:0:19502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:2.0:1782241464.552808:0:19502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e6d06ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:2399:x1868815120082560:12345-192.168.204.58@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1782241464.552904:0:19502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e6d06ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:2399:x1868815120082560:12345-192.168.204.58@tcp:16:lhsmtool_posix.0 Request processed in 98us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241464.552911:0:19502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:2.0:1782241464.557044:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241464.557271:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120082816 00000100:00100000:1.0:1782241464.557280:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120082816 00000100:00100000:1.0:1782241464.557351:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 69 00000100:00100000:1.0:1782241464.557361:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+14:15699:x1868815120082816:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782241464.557427:0:17048:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241464.557455:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a000/0xc9959f2fb1e1b04d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505697 expref: 14 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.557484:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890d4195bd00) 00010000:00010000:1.0:1782241464.557489:0:17048:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782241464.557519:0:17048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310c00/0xc9959f2fb1e1b05b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.557533:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310c00/0xc9959f2fb1e1b05b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.557544:0:17048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310c00/0xc9959f2fb1e1b05b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782241464.557660:0:17048:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005964d4c8 reply state 000000008523e6a0 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310c00/0xc9959f2fb1e1b05b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.557684:0:17048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310c00/0xc9959f2fb1e1b05b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17048 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.557690:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890d4195bd00) 00010000:00010000:1.0:1782241464.557693:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782241464.557695:0:17048:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782241464.557820:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+15:15699:x1868815120082816:12345-192.168.204.58@tcp:36:lhsmtool_posix.0 Request processed in 460us (785us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1782241464.557828:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 69 00000100:00100000:2.0:1782241464.582987:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241464.584091:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120082944 00000100:00100000:3.0:1782241464.584103:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120082944 00000100:00100000:3.0:1782241464.584158:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:3.0:1782241464.584168:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:15699:x1868815120082944:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782241464.584186:0:18554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782241464.584204:0:18554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e1b062 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335056a5 expref: -99 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.584236:0:18554:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b054 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d33350569e expref: 8 pid: 18556 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.584245:0:18554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241464.584249:0:18554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782241464.584255:0:18554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e1b062 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056a5 expref: 8 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.584290:0:18554:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b054 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350569e expref: 8 pid: 18556 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.584304:0:18554:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b054 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350569e expref: 8 pid: 18556 timeout: 627 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241464.584339:0:18554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d477fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18554:1868815140077696:192.168.204.58@tcp:104: 00000100:00100000:3.0:1782241464.584431:0:18554:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e779636c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241464.593592:0:18554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d477fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18554:1868815140077696:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241464.593641:0:18554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e1b062 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056a5 expref: 8 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.593676:0:18554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e8164ce00, rc 0) 00000100:00100000:2.0:1782241464.593737:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+8:15699:x1868815120082944:12345-192.168.204.58@tcp:101:lhsmtool_posix.0 Request processed in 9569us (10758us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241464.593752:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:3.0:1782241464.595875:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241464.596619:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120083072 00000100:00100000:1.0:1782241464.596629:0:17033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120083072 00010000:00010000:1.0:1782241464.596675:0:17033:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b054 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350569e expref: 8 pid: 18556 timeout: 627 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241464.596720:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:1.0:1782241464.596730:0:17033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+8:2399:x1868815120083072:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241464.596744:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241464.596782:0:17033:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b054 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350569e expref: 8 pid: 18556 timeout: 627 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.596796:0:17033:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b054 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350569e expref: 8 pid: 18556 timeout: 627 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.596820:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000538cf1b0/0xc9959f2fb1e1b054 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d33350569e expref: 8 pid: 18556 timeout: 627 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.596851:0:17033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241464.596855:0:17033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782241464.596862:0:17033:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e1b062 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056a5 expref: 7 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.596871:0:17033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e1b062 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056a5 expref: 7 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.596911:0:17033:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e1b062 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056a5 expref: 7 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241464.596926:0:17033:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4881df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17033:1868815140077824:192.168.204.58@tcp:105: 00000100:00100000:1.0:1782241464.597012:0:17033:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e47c4bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782241464.605084:0:17033:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4881df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17033:1868815140077824:192.168.204.58@tcp:105: 00010000:00010000:1.0:1782241464.605113:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241464.605178:0:17033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:2399:x1868815120083072:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 8448us (9307us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241464.605190:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 20 00000100:00100000:3.0:1782241464.607908:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241464.608019:0:18555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120083200 00000100:00100000:2.0:1782241464.608029:0:18555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120083200 00000100:00100000:2.0:1782241464.608088:0:18555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:2.0:1782241464.608099:0:18555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:2398:x1868815120083200:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1782241464.608238:0:18555:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782241464.608241:0:18555:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1782241464 00002000:00010000:2.0:1782241464.608244:0:18555:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1782241462 00002000:00010000:2.0:1782241464.608247:0:18555:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1782241464 -> 1782241464 00002000:00010000:2.0:1782241464.608249:0:18555:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1782241464.608310:0:18555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+8:2398:x1868815120083200:12345-192.168.204.58@tcp:2:lhsmtool_posix.0 Request processed in 212us (411us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1782241464.608318:0:18555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:3.0:1782241464.621049:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241464.621527:0:19502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120083328 00000100:00100000:2.0:1782241464.621538:0:19502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120083328 00000100:00100000:2.0:1782241464.621613:0:19502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 26 00000100:00100000:2.0:1782241464.621624:0:19502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4676f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+8:2397:x1868815120083328:12345-192.168.204.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1782241464.621673:0:19502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1b069 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.621694:0:19502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e1b062 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056a5 expref: 8 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.621719:0:19502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241464.621723:0:19502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782241464.621728:0:19502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1b069 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.621814:0:19502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e1b062 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056a5 expref: 8 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.621830:0:19502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e1b062 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056a5 expref: 8 pid: 18554 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241464.622144:0:19502:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19502:1868815140077952:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241464.622235:0:19502:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241464.625269:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241464.625584:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120083456 00000100:00100000:1.0:1782241464.625604:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120083456 00010000:00010000:1.0:1782241464.625642:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e1b062 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056a5 expref: 9 pid: 18554 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241464.625682:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 21 00000100:00100000:1.0:1782241464.625705:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+9:2398:x1868815120083456:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782241464.625720:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782241464.625741:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e1b062 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056a5 expref: 9 pid: 18554 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.625793:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e1b062 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056a5 expref: 9 pid: 18554 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.625821:0:17032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782241464.625826:0:17032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782241464.625832:0:17032:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1b069 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.625855:0:17032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1b069 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.625875:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782241464.625921:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+9:2398:x1868815120083456:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 218us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241464.625929:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 21 00010000:00010000:2.0:1782241464.626433:0:19502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046a28147/0xc9959f2fb1e1b062 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056a5 expref: 8 pid: 18554 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241464.626453:0:19502:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19502:1868815140077952:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241464.626474:0:19502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1b069 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.626485:0:19502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1b069 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.626506:0:19502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1b069 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.626527:0:19502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1b069 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.626536:0:19502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1b069 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.626544:0:19502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1b069 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.626551:0:19502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:2.0:1782241464.626556:0:19502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1b069 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.626565:0:19502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1b069 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.626579:0:19502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1b069 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.626587:0:19502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7a6fb4e/0xc9959f2fb1e1b069 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241464.626679:0:19502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4676f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:2397:x1868815120083328:12345-192.168.204.58@tcp:1:lhsmtool_posix.0 Request processed in 5057us (5641us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241464.626688:0:19502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 26 00000100:00100000:3.0:1782241464.634315:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241464.634428:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120083712 00000100:00100000:2.0:1782241464.634440:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120083712 00000100:00100000:2.0:1782241464.634513:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 70 00000100:00100000:2.0:1782241464.634522:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+15:15699:x1868815120083712:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782241464.634623:0:17049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1b070 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.634641:0:17049:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b600/0xc9959f2fb1e1af43 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505643 expref: 15 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.634652:0:17049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1b070 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.634686:0:17049:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b600/0xc9959f2fb1e1af43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505643 expref: 15 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.634699:0:17049:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b600/0xc9959f2fb1e1af43 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505643 expref: 15 pid: 17049 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241464.634713:0:17049:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17049:1868815140078080:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241464.634832:0:17049:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df566c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782241464.645408:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241464.645526:0:17049:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17049:1868815140078080:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241464.645570:0:17049:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1b070 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241464.645705:0:17034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120083840 00000100:00100000:3.0:1782241464.645712:0:17034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120083840 00010000:00010000:3.0:1782241464.645751:0:17034:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b600/0xc9959f2fb1e1af43 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505643 expref: 16 pid: 17049 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241464.645813:0:17034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00100000:3.0:1782241464.645823:0:17034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+16:2399:x1868815120083840:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782241464.645848:0:17034:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782241464.645856:0:17034:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b600/0xc9959f2fb1e1af43 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505643 expref: 16 pid: 17049 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.645869:0:17034:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b600/0xc9959f2fb1e1af43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505643 expref: 16 pid: 17049 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.645890:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b600/0xc9959f2fb1e1af43 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505643 expref: 16 pid: 17049 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.645907:0:17034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:3.0:1782241464.645920:0:17034:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1afd6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505674 expref: 15 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.645930:0:17034:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1b070 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.645938:0:17034:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1b070 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.645946:0:17034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1b070 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.645973:0:17034:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782241464.646033:0:17034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+15:2399:x1868815120083840:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 211us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241464.646041:0:17034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 22 00010000:00010000:2.0:1782241464.646326:0:17049:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1b070 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.646334:0:17049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1b070 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.646567:0:17049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b077 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.646580:0:17049:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1b03f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505690 expref: 15 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.646590:0:17049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b077 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.646707:0:17049:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1b03f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505690 expref: 15 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.646721:0:17049:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1b03f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505690 expref: 15 pid: 17046 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241464.646735:0:17049:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17049:1868815140078208:192.168.204.58@tcp:104: 00000100:00100000:2.0:1782241464.646824:0:17049:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e6df56540 going to sleep for 11 seconds 00000100:00100000:2.0:1782241464.652377:0:17049:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17049:1868815140078208:192.168.204.58@tcp:104: 00010000:00010000:2.0:1782241464.652408:0:17049:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b077 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782241464.654509:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241464.655155:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120083968 00000100:00100000:2.0:1782241464.655164:0:17032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120083968 00010000:00010000:2.0:1782241464.655207:0:17032:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1b03f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505690 expref: 16 pid: 17046 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241464.655244:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:2.0:1782241464.655254:0:17032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d41936450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+16:2396:x1868815120083968:12345-192.168.204.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782241464.655268:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782241464.655275:0:17032:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1b03f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505690 expref: 16 pid: 17046 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.655286:0:17032:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1b03f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505690 expref: 16 pid: 17046 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.655308:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d600/0xc9959f2fb1e1b03f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.58@tcp remote: 0x1a2492d333505690 expref: 16 pid: 17046 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.655324:0:17032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890d4195bd00) 00010000:00010000:2.0:1782241464.655330:0:17032:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b077 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.655340:0:17032:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b077 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.655348:0:17032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b077 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.655384:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782241464.655467:0:17032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d41936450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+15:2396:x1868815120083968:12345-192.168.204.58@tcp:103:ldlm_bl.0 Request processed in 214us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241464.655475:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 23 00010000:00010000:0.0:1782241464.655654:0:17049:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b077 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.655663:0:17049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b077 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782241464.655828:0:17049:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1782241464.655959:0:17049:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1782241464.656016:0:17049:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1782241464.656091:0:17049:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17049:1868815140078336:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1782241464.656139:0:17049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241464.656161:0:17049:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e67fff540 going to sleep for 11 seconds 00000100:00100000:2.0:1782241464.662605:0:18102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140078336 00000100:00100000:2.0:1782241464.662621:0:18102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140078336 00000100:00100000:2.0:1782241464.662691:0:18102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782241464.662702:0:18102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17049:x1868815140078336:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782241464.662866:0:18102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17049:x1868815140078336:12345-0@lo:1000:mdt00_002.0 Request processed in 165us (6725us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241464.662874:0:18102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782241464.663148:0:17049:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17049:1868815140078336:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1782241464.663346:0:17049:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1782241464.663442:0:17049:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17049:1868815140078464:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1782241464.663488:0:17049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241464.663518:0:17049:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e480d80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782241464.664082:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140078464 00000100:00100000:2.0:1782241464.664088:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140078464 00000100:00100000:2.0:1782241464.664131:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782241464.664139:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17049:x1868815140078464:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782241464.664265:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17049:x1868815140078464:12345-0@lo:1000:mdt00_002.0 Request processed in 126us (776us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1782241464.664274:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782241464.664351:0:17049:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17049:1868815140078464:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1782241464.664393:0:17049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b077 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.664404:0:17049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b077 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.664424:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b077 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.664432:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43faca00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241464.664437:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b077 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.664445:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b077 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.664476:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890d4195bd00) 00010000:00010000:3.0:1782241464.664479:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782241464.664484:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b077 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.664491:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43faca00/0xc9959f2fb1e1b077 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.664521:0:17049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1afcf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.664527:0:17049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1afcf lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.664532:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1afcf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.664537:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d800 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241464.664539:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1afcf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.664544:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1afcf lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.664551:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:3.0:1782241464.664553:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782241464.664560:0:17049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1afd6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505674 expref: 18 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.664570:0:17049:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1afd6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505674 expref: 18 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.664586:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1afd6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505674 expref: 18 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.664654:0:17049:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff890e7c310200/0xc9959f2fb1e1afd6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d333505674 expref: 18 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241464.664667:0:17049:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47830000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17049:1868815140078592:192.168.204.58@tcp:105: 00000100:00100000:3.0:1782241464.664723:0:17049:0:(client.c:2701:ptlrpc_set_wait()) set ffff890e779636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782241464.681435:0:17049:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47830000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17049:1868815140078592:192.168.204.58@tcp:105: 00010000:00010000:3.0:1782241464.681467:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1afcf lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681479:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d800/0xc9959f2fb1e1afcf lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681512:0:17049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1b07e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681527:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1b07e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681539:0:17049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1b07e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681549:0:17049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1b07e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681555:0:17049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1b07e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681580:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1b07e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681586:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e8164d200 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241464.681590:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1b07e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681604:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1b07e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681617:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:3.0:1782241464.681620:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782241464.681624:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1b07e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681630:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e8164d200/0xc9959f2fb1e1b07e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681640:0:17049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1b070 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681647:0:17049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1b070 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681653:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1b070 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681658:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fad400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:3.0:1782241464.681661:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1b070 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681676:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1b070 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681707:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:3.0:1782241464.681711:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782241464.681715:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1b070 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782241464.681721:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad400/0xc9959f2fb1e1b070 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17049 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782241464.681931:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+18:15699:x1868815120083712:12345-192.168.204.58@tcp:57:lhsmtool_posix.0 Request processed in 47408us (47626us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1782241464.681943:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 70 00000020:00080000:3.0:1782241464.681951:0:17049:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1782241464.682033:0:17085:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1782241464.682039:0:17085:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782241464.682055:0:17085:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1782241464.682063:0:17085:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1782241464.682719:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241464.683500:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120084096 00000100:00100000:3.0:1782241464.683509:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120084096 00000100:00100000:3.0:1782241464.683608:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:3.0:1782241464.683619:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+18:15698:x1868815120084096:12345-192.168.204.58@tcp:49:bash.0 00000100:00100000:3.0:1782241464.683750:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+18:15698:x1868815120084096:12345-192.168.204.58@tcp:49:bash.0 Request processed in 132us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241464.683774:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 12 00000100:00100000:1.0:1782241464.693079:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241464.693164:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120084352 00000100:00100000:0.0:1782241464.693186:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120084352 00000100:00100000:0.0:1782241464.693243:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 13 00000100:00100000:0.0:1782241464.693254:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+18:15699:x1868815120084352:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1782241464.693529:0:17051:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1782241464.693562:0:17051:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1782241464.693599:0:17051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a200/0xc9959f2fb1e1b085 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.693617:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a200/0xc9959f2fb1e1b085 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.693629:0:17051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a200/0xc9959f2fb1e1b085 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.693639:0:17051:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a200/0xc9959f2fb1e1b085 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.693646:0:17051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a200/0xc9959f2fb1e1b085 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.693653:0:17051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a200/0xc9959f2fb1e1b085 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782241464.693677:0:17051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782241464.693785:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+20:15699:x1868815120084352:12345-192.168.204.58@tcp:35:lhsmtool_posix.0 Request processed in 532us (716us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1782241464.693794:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 13 00000020:00080000:0.0:1782241464.693799:0:17051:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782241464.693865:0:17036:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782241464.693872:0:17036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a200/0xc9959f2fb1e1b085 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.693891:0:17036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e4499a200 already unused, calling callback (ffffffffc0cc6ce0) 00010000:00010000:1.0:1782241464.693895:0:17036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a200/0xc9959f2fb1e1b085 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.693903:0:17036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a200/0xc9959f2fb1e1b085 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.693917:0:17036:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff890d4195bd00) 00010000:00010000:1.0:1782241464.693920:0:17036:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782241464.693924:0:17036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a200/0xc9959f2fb1e1b085 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.693930:0:17036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499a200/0xc9959f2fb1e1b085 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17051 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782241464.693942:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241464.693944:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782241464.693946:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782241464.706569:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241464.706663:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120084480 00000100:00100000:2.0:1782241464.706673:0:18554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120084480 00000100:00100000:2.0:1782241464.706739:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 27 00000100:00100000:2.0:1782241464.706750:0:18554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+7:15698:x1868815120084480:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:2.0:1782241464.706809:0:18554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241464.706833:0:18554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028a456b9/0xc9959f2fb1e1b08c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335056ac expref: -99 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782241464.706877:0:18554:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a3ad8b8, atime: 0x6a3ad8b6, ctime: 0x6a3ad8b8, blocks: 0x0 00010000:00010000:2.0:1782241464.706900:0:18554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1782241464.706905:0:18554:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782241464.706915:0:18554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028a456b9/0xc9959f2fb1e1b08c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056ac expref: 8 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.706932:0:18554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000028a456b9/0xc9959f2fb1e1b08c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056ac expref: 8 pid: 18554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.706947:0:18554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad000, rc 0) 00000100:00100000:2.0:1782241464.707016:0:18554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+8:15698:x1868815120084480:12345-192.168.204.58@tcp:101:bash.0 Request processed in 268us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241464.707024:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 27 00000100:00100000:1.0:1782241464.709323:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241464.709442:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120084608 00000100:00100000:2.0:1782241464.709451:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120084608 00000100:00100000:2.0:1782241464.709509:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 71 00000100:00100000:2.0:1782241464.709520:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+20:15698:x1868815120084608:12345-192.168.204.58@tcp:101:bash.0 00010000:00010000:2.0:1782241464.709548:0:19501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782241464.709570:0:19501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1b093 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335056b3 expref: -99 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.709607:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b09a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.709622:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b09a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.709649:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b09a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.709806:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1b093 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056b3 expref: 22 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.709823:0:19501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fad200/0xc9959f2fb1e1b09a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056b3 expref: 21 pid: 19501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.709832:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:2.0:1782241464.709835:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782241464.709838:0:19501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e43fad200, rc 0) 00000100:00100000:2.0:1782241464.709890:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+21:15698:x1868815120084608:12345-192.168.204.58@tcp:101:bash.0 Request processed in 372us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241464.709898:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 71 00000100:00100000:1.0:1782241464.725787:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241464.726007:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120084864 00000100:00100000:3.0:1782241464.726016:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120084864 00000100:00100000:3.0:1782241464.726075:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 14 00000100:00100000:3.0:1782241464.726085:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+21:15698:x1868815120084864:12345-192.168.204.58@tcp:35:bash.0 00000001:00080000:3.0:1782241464.726308:0:17050:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1782241464.726429:0:17050:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1782241464.726534:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+24:15698:x1868815120084864:12345-192.168.204.58@tcp:35:bash.0 Request processed in 449us (783us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1782241464.726542:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 14 00000020:00080000:3.0:1782241464.726547:0:17050:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1782241464.860170:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241464.860384:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120085120 00000100:00100000:0.0:1782241464.860394:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120085120 00000100:00100000:0.0:1782241464.860547:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 72 00000100:00100000:0.0:1782241464.860570:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+24:15709:x1868815120085120:12345-192.168.204.58@tcp:101:lfs.0 00010000:00010000:0.0:1782241464.860596:0:17046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782241464.860618:0:17046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b600/0xc9959f2fb1e1b0a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a2492d3335056ba expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782241464.860719:0:17046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782241464.864081:0:17046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b600/0xc9959f2fb1e1b0a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056ba expref: 26 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.864105:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff890e45e7a300) 00010000:00010000:2.0:1782241464.864109:0:17046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782241464.864114:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e4499b600/0xc9959f2fb1e1b0a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.58@tcp remote: 0x1a2492d3335056ba expref: 26 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.864130:0:17046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff890e4499b600, rc 0) 00000100:00100000:2.0:1782241464.864211:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+25:15709:x1868815120085120:12345-192.168.204.58@tcp:101:lfs.0 Request processed in 3643us (4050us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1782241464.864237:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 72 00000100:00100000:1.0:1782241464.885163:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:2.0:1782241464.885251:0:19501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120085248 00000100:00100000:2.0:1782241464.885262:0:19501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120085248 00000100:00100000:2.0:1782241464.885318:0:19501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 73 00000100:00100000:2.0:1782241464.885336:0:19501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+25:15709:x1868815120085248:12345-192.168.204.58@tcp:34:lfs.0 00010000:00010000:2.0:1782241464.885406:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1b0af lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885432:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1b0af lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885445:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1b0af lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885468:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1b0b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885476:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1b0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885484:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1b0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885560:0:19501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1b0bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885569:0:19501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1b0bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885577:0:19501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1b0bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782241464.885637:0:19501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1b0bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885649:0:19501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1b0af lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885656:0:19501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1b0af lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885663:0:19501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1b0af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885670:0:19501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fac400 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241464.885674:0:19501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1b0af lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885682:0:19501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1b0af lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885694:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff890d4195b000) 00010000:00010000:2.0:1782241464.885697:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241464.885702:0:19501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1b0af lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885709:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fac400/0xc9959f2fb1e1b0af lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885720:0:19501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1b0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885727:0:19501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1b0b6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885739:0:19501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1b0b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.885745:0:19501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43fade00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241464.885748:0:19501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1b0b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.886057:0:19501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1b0b6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.886071:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff890e45e7ac00) 00010000:00010000:2.0:1782241464.886073:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241464.886077:0:19501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1b0b6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.886084:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43fade00/0xc9959f2fb1e1b0b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.886100:0:19501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1b0bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.886107:0:19501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1b0bd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.886113:0:19501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1b0bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.886119:0:19501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff890e43face00 already unused, calling callback (ffffffffc18bb4f0) 00010000:00010000:2.0:1782241464.886123:0:19501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1b0bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.886140:0:19501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1b0bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.886148:0:19501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff890e81803b00) 00010000:00010000:2.0:1782241464.886151:0:19501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782241464.886154:0:19501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1b0bd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782241464.886160:0:19501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff890e43face00/0xc9959f2fb1e1b0bd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782241464.886232:0:19501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+25:15709:x1868815120085248:12345-192.168.204.58@tcp:34:lfs.0 Request processed in 896us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241464.886240:0:19501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 73 00000100:00100000:1.0:1782241464.889472:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:3.0:1782241464.889557:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120085504 00000100:00100000:3.0:1782241464.889567:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120085504 00000100:00100000:3.0:1782241464.889632:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 15 00000100:00100000:3.0:1782241464.889643:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+25:15709:x1868815120085504:12345-192.168.204.58@tcp:35:lfs.0 00000100:00100000:3.0:1782241464.889886:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+26:15709:x1868815120085504:12345-192.168.204.58@tcp:35:lfs.0 Request processed in 244us (430us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1782241464.889894:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 15 00010000:00010000:3.0:1782241465.093041:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782241466.118413:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782241466.118445:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140078720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782241466.118555:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782241466.119344:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782241466.121626:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140078720 00000100:00100000:2.0:1782241466.121646:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140078720 00000100:00100000:2.0:1782241466.123616:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782241466.123635:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140078720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782241466.123681:0:18557:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1782241466.124074:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140078720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 443us (5517us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241466.124084:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782241466.124155:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140078720:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1782241466.126674:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782241466.269470:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241466.269528:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241466.269562:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241466.269591:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241466.269614:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241466.269649:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241466.269670:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241466.269691:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241466.269717:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241466.269750:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120085888 00000100:00100000:1.0:1782241466.269789:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120085888 00000100:00100000:1.0:1782241466.269859:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120086400 00000100:00100000:1.0:1782241466.269863:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120086400 00000100:00100000:1.0:1782241466.269878:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120085760 00000100:00100000:1.0:1782241466.269881:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120085760 00000100:00100000:1.0:1782241466.269897:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120086272 00000100:00100000:1.0:1782241466.269899:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120086272 00000100:00100000:1.0:1782241466.269917:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 64 00000100:00100000:1.0:1782241466.269928:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120085888:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241466.270034:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120085888:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 107us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241466.270044:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 64 00000100:00100000:1.0:1782241466.270063:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 65 00000100:00100000:1.0:1782241466.270070:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120086400:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241466.270094:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120086400:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 25us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241466.270101:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 65 00000100:00100000:1.0:1782241466.270113:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 66 00000100:00100000:1.0:1782241466.270120:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+26:2399:x1868815120085760:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241466.270148:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+26:2399:x1868815120085760:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 29us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241466.270155:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 66 00000100:00100000:1.0:1782241466.270175:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 67 00000100:00100000:1.0:1782241466.270181:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2399:x1868815120086272:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241466.270209:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:665bb25c-92e8-4fb6-a390-44e1dde8222e+6:2399:x1868815120086272:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 27us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241466.270214:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 67 00000100:00100000:1.0:1782241466.270236:0:19502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120086144 00000100:00100000:1.0:1782241466.270240:0:19502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120086144 00000100:00100000:1.0:1782241466.270268:0:19502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120086656 00000100:00100000:1.0:1782241466.270271:0:19502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120086656 00000100:00100000:1.0:1782241466.270283:0:19502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120086016 00000100:00100000:1.0:1782241466.270285:0:19502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120086016 00000100:00100000:1.0:1782241466.270298:0:19502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120086528 00000100:00100000:1.0:1782241466.270301:0:19502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120086528 00000100:00100000:1.0:1782241466.270316:0:19502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00100000:1.0:1782241466.270322:0:19502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120086144:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241466.270350:0:19502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+5:2399:x1868815120086144:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 28us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241466.270357:0:19502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 22 00000100:00100000:1.0:1782241466.270369:0:19502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:1.0:1782241466.270375:0:19502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4881fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120086656:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241466.270414:0:19502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4881fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120086656:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 38us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241466.270421:0:19502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 23 00000100:00100000:1.0:1782241466.270433:0:19502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:1.0:1782241466.270439:0:19502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d45a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+8:2399:x1868815120086016:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241466.270462:0:19502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d45a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+8:2399:x1868815120086016:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 23us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241466.270475:0:19502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 24 00000100:00100000:1.0:1782241466.270486:0:19502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00100000:1.0:1782241466.270493:0:19502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120086528:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:1.0:1782241466.270517:0:19502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:665bb25c-92e8-4fb6-a390-44e1dde8222e+5:2399:x1868815120086528:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 25us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241466.270523:0:19502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 25 00000100:00080000:1.0:1782241466.270550:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782241466.270555:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241466.270558:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782241466.270560:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782241466.271035:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120085632 00000100:00100000:2.0:1782241466.271042:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120085632 00000100:00100000:2.0:1782241466.271076:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 168 00000100:00100000:2.0:1782241466.271083:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+13:2399:x1868815120085632:12345-192.168.204.58@tcp:400:kworker.0 00000100:00100000:2.0:1782241466.271146:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1eaa300c-78b6-4e0f-8097-bd653788406c+13:2399:x1868815120085632:12345-192.168.204.58@tcp:400:kworker.0 Request processed in 62us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241466.271155:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 168 00000100:00100000:0.0:1782241466.629393:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4793df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140078848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782241466.629518:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241466.629607:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140078848 00000100:00100000:0.0:1782241466.629616:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140078848 00000100:00100000:0.0:1782241466.629683:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782241466.629693:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140078848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782241466.629746:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782241466.629837:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140078848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782241466.629847:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782241466.629917:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4793df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140078848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782241466.632542:0:3638:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140078976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782241466.632630:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241466.632700:0:18102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140078976 00000100:00100000:1.0:1782241466.632709:0:18102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140078976 00000100:00100000:1.0:1782241466.632787:0:18102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782241466.632797:0:18102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140078976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782241466.632839:0:18102:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1782241466.633024:0:18102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1868815140078976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 165us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241466.633032:0:18102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782241466.633164:0:3638:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1868815140078976:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1782241466.663034:0:20226:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1782241467.140957:0:17036:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782241467.141025:0:3639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d47831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140079104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241467.141036:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890d4809ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140079232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782241467.142580:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782241467.146659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241467.146670:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140079744:0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.146741:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241467.146784:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140080256:0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.146811:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241467.146831:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815140080768:0@lo:400:kworker.0 00000100:00100000:2.0:1782241467.146834:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140079360:0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.146857:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241467.146881:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1782241467.146888:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140079616:0@lo:400:kworker.0 00000100:00100000:2.0:1782241467.146895:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241467.147065:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140079872:0@lo:400:kworker.0 00000100:00100000:2.0:1782241467.147094:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241467.147117:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140080384:0@lo:400:kworker.0 00000100:00100000:2.0:1782241467.147141:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241467.147163:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140080896:0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.147172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241467.147199:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140080128:0@lo:400:kworker.0 00000100:00100000:2.0:1782241467.147201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782241467.148132:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140079232 00000100:00100000:3.0:1782241467.148145:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140079232 00000100:00100000:3.0:1782241467.148170:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140080768 00000100:00100000:3.0:1782241467.148173:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140080768 00000100:00100000:3.0:1782241467.148649:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140079872 00000100:00100000:3.0:1782241467.148654:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140079872 00000100:00100000:3.0:1782241467.148673:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140080384 00000100:00100000:3.0:1782241467.148677:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140080384 00000100:00100000:3.0:1782241467.148688:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140080896 00000100:00100000:3.0:1782241467.148690:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140080896 00000100:00100000:3.0:1782241467.148714:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782241467.148725:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815140080768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241467.151420:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1782241467.151939:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140079488:0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.151997:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241467.152106:0:3640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140080640:0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.152136:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241467.152180:0:19502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140079744 00000100:00100000:1.0:1782241467.152189:0:19502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140079744 00000100:00100000:2.0:1782241467.152299:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241467.152337:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140080000:0@lo:400:kworker.0 00000100:00100000:2.0:1782241467.152361:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241467.152394:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140080512:0@lo:400:kworker.0 00000100:00100000:2.0:1782241467.152418:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782241467.152431:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff890e7c33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140081024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782241467.152470:0:19502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140080256 00000100:00100000:1.0:1782241467.152475:0:19502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140080256 00000100:00100000:2.0:1782241467.152480:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140079360 00000100:00100000:2.0:1782241467.152487:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140079360 00000100:00100000:1.0:1782241467.152497:0:19502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140079616 00000100:00100000:1.0:1782241467.152502:0:19502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140079616 00000100:00100000:1.0:1782241467.152521:0:19502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140080128 00000100:00100000:2.0:1782241467.152535:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1782241467.152535:0:19502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140080128 00000100:00100000:2.0:1782241467.152550:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7f5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3637:x1868815140079360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.152561:0:19502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782241467.152572:0:19502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4809b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140079744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.152636:0:19502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4809b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1868815140079744:12345-0@lo:400:kworker.0 Request processed in 67us (5894us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241467.152644:0:19502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782241467.152664:0:19502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782241467.152670:0:19502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140080256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.152710:0:19502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140080256:12345-0@lo:400:kworker.0 Request processed in 40us (5900us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241467.152717:0:19502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782241467.152728:0:19502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782241467.152734:0:19502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3640:x1868815140079616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782241467.153883:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7f5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb+24:3637:x1868815140079360:12345-0@lo:400:kworker.0 Request processed in 1329us (6984us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241467.153896:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1782241467.153952:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140080640 00000100:00100000:2.0:1782241467.153960:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140080640 00000100:00100000:1.0:1782241467.154032:0:19502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3640:x1868815140079616:12345-0@lo:400:kworker.0 Request processed in 1294us (6858us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241467.154041:0:19502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782241467.154061:0:19502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782241467.154070:0:19502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140080128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.154106:0:19502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1868815140080128:12345-0@lo:400:kworker.0 Request processed in 38us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241467.154113:0:19502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782241467.154139:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140080512 00000100:00100000:1.0:1782241467.154143:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140080512 00000100:00100000:1.0:1782241467.154176:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782241467.154184:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e7c33d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140079872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.154224:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e7c33d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1868815140079872:12345-0@lo:400:kworker.0 Request processed in 41us (7130us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241467.154230:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782241467.154245:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782241467.154252:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140080384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.154428:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1868815140080384:12345-0@lo:400:kworker.0 Request processed in 31us (7142us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241467.154436:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782241467.154465:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782241467.155883:0:17048:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1782241467.155899:0:17048:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1782241467.155939:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140079104 00000100:00100000:2.0:1782241467.155947:0:18557:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140079104 00000100:00100000:2.0:1782241467.156154:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782241467.156167:0:18557:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d4793df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140079104:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241467.156189:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815140080896:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1782241467.156207:0:18557:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1782241467.156509:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1868815140080896:12345-0@lo:400:kworker.0 Request processed in 2036us (9309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241467.156517:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782241467.156543:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782241467.156551:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140080512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.156588:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1868815140080512:12345-0@lo:400:kworker.0 Request processed in 39us (4169us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241467.156594:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782241467.156620:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782241467.156628:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140080640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.156659:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1868815140080640:12345-0@lo:400:kworker.0 Request processed in 33us (4523us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241467.156666:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1782241467.156836:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782241467.156842:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782241467.156845:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782241467.156847:0:17043:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782241467.156869:0:18102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140079488 00000100:00100000:1.0:1782241467.156874:0:18102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140079488 00000100:00100000:1.0:1782241467.156914:0:18102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140080000 00000100:00100000:1.0:1782241467.156918:0:18102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140080000 00000100:00100000:1.0:1782241467.156932:0:18102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782241467.156937:0:18102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d477fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140079488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.156976:0:18102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d477fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140079488:12345-0@lo:400:kworker.0 Request processed in 38us (4678us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241467.157001:0:18102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782241467.157013:0:18102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782241467.157019:0:18102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890e47aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140080000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.157051:0:18102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890e47aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1868815140080000:12345-0@lo:400:kworker.0 Request processed in 32us (4689us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241467.157057:0:18102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782241467.157119:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140079616:0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.157136:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140080128:0@lo:400:kworker.0 00010000:00080000:1.0:1782241467.157154:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7c33dc00 x1868815140080640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241467.157165:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1868815140080640:0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.157181:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140079744:0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.157193:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1868815140080256:0@lo:400:kworker.0 00000100:00100000:2.0:1782241467.158041:0:18557:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d4793df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1868815140079104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1872us (11390us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241467.158054:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782241467.158129:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782241467.158138:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d48099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1868815140079232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782241467.158161:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1782241467.158223:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1868815140079232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (15648us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241467.158229:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782241467.158270:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d4809ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1868815140079232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782241467.158825:0:3639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890d47831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1868815140079104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782241467.159112:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782241467.159149:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5d8e322-cb86-4bf4-a411-4939f9bbdcbb:3637:1868815140079360:0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.159167:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1868815140079872:0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.159181:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1868815140080384:0@lo:400:kworker.0 00010000:00080000:1.0:1782241467.159196:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff890e7c33f100 x1868815140080896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782241483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782241467.159208:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1868815140080896:0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.159239:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140079488:0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.159270:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1868815140080000:0@lo:400:kworker.0 00000100:00100000:1.0:1782241467.159297:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1868815140080512:0@lo:400:kworker.0 00000100:00100000:2.0:1782241467.160311:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815140081024 00000100:00100000:2.0:1782241467.160325:0:18558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815140081024 00000100:00100000:2.0:1782241467.160405:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782241467.160418:0:18558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140081024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782241467.160462:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782241467.160923:0:18558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1868815140081024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 507us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1782241467.160932:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782241467.162409:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d48135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1868815140080768:12345-0@lo:400:kworker.0 Request processed in 13676us (15540us total) trans 0 rc 0/0 00000100:00100000:3.0:1782241467.162425:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782241467.162541:0:3640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1868815140080768:0@lo:400:kworker.0 00000100:00100000:0.0:1782241467.163702:0:3637:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff890e7c33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1868815140081024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782241467.807969:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:1.0:1782241467.808012:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.58@tcp (source: 12345-192.168.204.58@tcp) 00000100:00100000:0.0:1782241467.808179:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120086784 00000100:00100000:0.0:1782241467.808191:0:18559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120086784 00002000:00100000:0.0:1782241467.808237:0:18559:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff890d47b4dc00 x1868815120086784/t0(0) o4->90b92c6b-99f4-4cbe-a9f0-708a58cf844d@192.168.204.58@tcp:558/0 lens 504/0 e 0 to 0 dl 1782241478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1782241467.808269:0:18559:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d47b4dc00 with x1868815120086784 ext(0->8) 00002000:00010000:0.0:1782241467.808275:0:18559:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff890d47b4dc00 00000100:00100000:0.0:1782241467.808314:0:18559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 0 00000100:00100000:0.0:1782241467.808323:0:18559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+8:2397:x1868815120086784:12345-192.168.204.58@tcp:4:bash.0 00000100:00100000:0.0:1782241467.809484:0:18559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+10:2397:x1868815120086784:12345-192.168.204.58@tcp:4:bash.0 Request processed in 1154us (1517us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1782241467.809497:0:18559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 0 00002000:00100000:0.0:1782241467.809508:0:18559:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff890d47b4dc00 x1868815120086784/t8589934599(0) o4->90b92c6b-99f4-4cbe-a9f0-708a58cf844d@192.168.204.58@tcp:558/0 lens 504/448 e 0 to 0 dl 1782241478 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1782241467.809519:0:18559:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff890d47b4dc00 with x1868815120086784 ext(0->8) 00000100:00100000:3.0:1782241467.809525:0:19502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868815120086912 00002000:00010000:0.0:1782241467.809525:0:18559:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff890d47b4dc00 00000100:00100000:3.0:1782241467.809534:0:19502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868815120086912 00000100:00100000:3.0:1782241467.809578:0:19502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.58@tcp, seq: 28 00000100:00100000:3.0:1782241467.809588:0:19502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff890d47b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+10:2397:x1868815120086912:12345-192.168.204.58@tcp:16:kworker.0 00000001:00080000:0.0:1782241467.811888:0:18550:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1782241467.811908:0:18550:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000100:00100000:1.0:1782241467.813750:0:19502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff890d47b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:90b92c6b-99f4-4cbe-a9f0-708a58cf844d+6:2397:x1868815120086912:12345-192.168.204.58@tcp:16:kworker.0 Request processed in 4152us (5725us total) trans 0 rc 0/0 00000100:00100000:1.0:1782241467.813783:0:19502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.58@tcp, seq: 28 00010000:00010000:3.0:1782241468.165109:0:18201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42945 lines, 42945 kept, 0 dropped, 0 bad.